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PREFACE 


The object of this Report, which we present to the pubhc on 
behalf of our Committee, is constructive rather than critical. 
The last chapter (Chapter VIII) contains a number of Recom- 
mendations for future action to which we draw the attention of 
our readers. Those Recommendations are based in part on 
previous work of the members of the Sub-Committee by whom 
the Report has been drawn up, in part on the results of the 
investigation which it records, and on the inability of examiners 
accustomed to the present methods of teaching English and 
examining in English composition to attain a satisfactory degree 
of consistency in the marking of English essays. But we must 
leave the book and its Recommendations to speak for themselves. 
They deal with fundamentals in the teaching of the mother- 
tongue — the most important element in the national education, 
as it was imtil recent years the most neglected — and in the 
examinations in that subject. 

The experimental part of the investigations which we record 
was begun in 1935 and completed in 1938. But the issue of this 
book has been delayed owing to the illness of some of the persons 
concerned and the exigencies of the war. Of the five persons who 
formed the Sub-Committee which supervised the investigation 
only Dr. Ballard and the Director were available for the drafting 
of Chapters and VHI, and of the Notes at the end of the 
book.^ We have appended below the aclinowledgments of our 
Committee to the numerous bodies and persons who have 
assisted directly or indirectly in the present investigation ; but 
we -wish to record, in this sixth and last book to be published 
by our Committee, our primarj’^ obligations to those bodies 
and persons who made our undertaking possible in the first 
instance. Those bodies were the Carnegie Corporation, the 
Carnegie Foxmdation, and the International Institute of 
Teachers College, Colmnbia University, New York. . The 
movement was initiated at an international conference, held 
at Eastbourne, imder the auspices of these three American 

* Dr. Gurrey rejoined the Royal Air Force early in the \rar ; Dr. Ebble white 
Smith left England to fill a Chair of Education at Winnipeg at the request of the 
Govommcnt of Manitoba ; and Professor Hamley has gone recently to Irak on 
a mission for the Britisli Council. 
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organisations, in May, 1931 ; and it was followed by similar 
conferences at Folkestone in Jnno, 1935, and at Dinard, in 
France, in September, 1938. All the conferences were organised 
by Dr. Paul Monroe, Director of the International Institute, and 
held under his able chairmanship. Dr. Monroe also edited their 
published proceedings.’ The conferences were attended not 
only by representatives of the several European committees," 
but on each occasion also by a contingent of outstanding repre- 
sentatives of the United States. The proceedings contain verbatim 
reports of the speeches and discussions, many of them lively, and 
some of them brilliant. They give a first-hand impression of 
features in the examination systems of different countries not to 
be found elsewhere. The meetings have left in the minds of 
those of us who attended them unforgettable memories, not alone 
of the discussions, but of the hospitality and understanding of 
our American hosts ; and above all of Dr. Monroe, that veteran 
figure in American education, who has been the life and soul of 
the movement, and of Dr. F. P. Keppel, the statesmanlike 
President of the Carnegie Corporation, which supplied the funds 
for the scheme through the International Institute. Dr. Monroe 
related at Dinard how the movement originated, some 10 or 11 
years ago, in a conversation between Dr. Keppel and himself, 
though the parts played by the two men have been fused in their 
common recollections.’ 

It was by the desire of the French representatives that the 
last conference was held in France. It was held, under the 
shadow of war, in the tense fortnight preceding the days of 
Munich ; but the spirit of the conference was one of international 
co-operation. Of its memories none will be more permanent 
than that of the hours spent on a lovely bay in Brittany, in the 
country-house of M. Celestin BougM, Director of the Ecole 
Noimale Superieure in Paris, whose recent death we deplore. At 
the end of the conference, on the suggestion of Professor Drever, 
of Edinburgh, an informal international committee was set up 

The three volumes of Proceedings were published in 1931, 193G,,and 1939, 
respectively, by the Bureau of Publications, Teachers College, Columbia 
University, New York. The short title of each volume is “ Conference on 
Examinations,” followed by the name of the place in which it was held. 

* Committees parallel to our own were eatablidied in the following countries : 
Finland, France, Germany, Norway, Scotland, Sweden and Switzerland. These 
committees have simultaneously investigated such problems of examinations as 
they regarded as urgent and have published books or memoirs on the subject. 
3Je German committee ceased to function not long after the establishment of 
the Nazi regime. 

’ See the Proceedings of the Dinard Conference, pp. 8-11. 
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(Anth Professor Drever as convener) to arrange for a further 
meeting at a date and place to be fixed in the future. 

There is one more thing to report. The Carnegie Corporation 
spontaneously offered the English Committee a sum up to the 
limit of §10,000, to be matched by a like amount from England, 
as the nucleus of a fund for educational research in this country, 
not limited to questions relative to examinations. With the 
approval of the American donors it was decided that the fund 
should be devoted to grants for approved researches, open to 
anyone in England and Wales (on the model of those made by 
the Royal Society) and to bo administered by the University of 
London Institute of Education with the assistance of an Advisory 
Council. Before the war, considerable progress had been made 
■nuth the scheme. Negotiations were being carried on with a 
view to enlist the support of the local education authorities of 
England and Wales, through the important associations of 
officials and others connected with them ; of the great associations 
of teachers such as the National Union of Teachers and the four 
associations of Secondary Teachers ; and of other bodies such as 
the National Institute of Industrial Psychology. With the onset 
of war, the possibility of setting up a complex system of 
administration and finance of the kind contemplated dis- 
appeared ; but the Leverhulme Trustees very generously allowed 
their offer of £1,000 for the scheme to stand, and the American 
supporters immediately cabled a like sum to match this gift. 
These sums have now been transferred by our Committee to the 
Institute of Education, which is, for the moment, located at 
University College, Nottingham. It is understood that the 
Institute, of which Professor Fred Clarke is the Director, 
will now be prepared to make grants from the capital for 
educational researches of which the utility at the present time 
is recognised ; and it is hoped that further donations for the same 
purpose will be received. The fund is to be called the Carnegie 
Fund for Educational Research. 

The joint action of Dr. Monroe, of Dr. Keppel, and of Dr. 
Walter Jessup, President of the Carnegie Foundation, will, we 
trust, long bear fruit in this sister country to the United States, ' 
to wliich we are bound more than ever by ties of kinship, under- 
standing, affection, and a common tradition of humanity. 


Acknoivledgments 

We have a number of acknowledgments to make on behalf of 
the main Committee to those who helped our Sub-Committee 
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in the production of this Report. First and foremost to Dr. 
Ebhlewhite Smith and to his -wife, who gave their time without 
stint or reward to the laborious analysis of statistical results 
recorded mainly in Chapter III. Their w’ork and that of their 
colleagues has served as a corner-stone of the conclusions arrived 
at. To Dr. Ballard, Dr. Percival Gurrey and Professor Hamley, 
who served with Dr. Smith as members of the Sub-Committee, 
and to Professors Cyril Burt, Spearman and Godfre}’" Thomson, 
who made valuable suggestions at a later stage, we owe sincere 
gratitude. We desire to acknowledge also the assistance of the 
University of London Institute of Education, for providing 
accommodation for the meetings of the examiners ; and' our 
obligations to SEss Gladys Roberts, Mr. E. C. Rubidge, Miss 
Ann Wright and lEss G. Rohatyn, for skilled clerical assistance 
at various stages of the work, and to Mr. G. B. N. Hartog and 
Mr. Roger Hartog for the time they voluntarily devoted in 
the early stages to dealing with the thousands of scripts in our 
hands, thus avoiding the necessity of engaging additional staff. 
The Sub-Committee, in the text of the Report, have recorded the 
great debt which they owe, not only to the educational authorities 
concerned, but also to the headmasters and headmistresses and 
English teachers of the schools participating in the enquiry for 
having carried out the directions for the conduct of the exami- 
nations and tests, in faithful accordance with the schemes laid 
down both for the preliminary and for the final investigations. 
Without their invaluable co-operation the investigations could 
not have been carried out. We are also indebted to the National 
Institute of Industrial Psychology for allowing our Sub-Committee 
the use of their Group-Intelligence Test No. 133 with its 193 
items and for scoring the papers of the candidates. 

Finally, we have to express to Sir. P. H. B. Lyon, Headmaster 
of Rugby, our thanks for communicating to us the results of an 
interesting test in the ma rkin g of school essays carried out by two 
members of his staff ; and to Dr. P. A. Hedgcock, Inspector 
under the London Coimty Council, for a promising investigation 
on a method of marking French compositions, which however it 
was impossible to advance to a stage suitable for the publication 
of the results. 


For the Committee, 

M. E. Sadler, Ohairtnan. 
P. J. Hartog, Direclor. 


April, 1941 
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THE 

MARKING OF ENGLISH ESSAYS 

CHAPTER I.— INTRODUCTORY 

1. It is generally agreed that of all the problems Trliich 
examiners have to face there is none more difficult than the 
marking of the English Essay. The main object of the investiga- 
tions dealt with in this Report was to ascertain whether by the 
introduction of a new element into the marking the vah'dity and 
the consistency of the examination could both be improved. 

2. For the sake of brevity this element was called “ sense.” 
But the precise connotation with which the word was used needs 
fimther explanation. 

In previous work on the subject by the Director of the Enquiry 
it was pointed out that in real life a person does not just “ write.” 
He wTites for a given audience and with a given object in view, 
which may be to explain, to persuade, to convey an order, to * 
amuse, to inspire, or indeed to fulfil any other purpose or com- 
bination of purposes.' The word “ sense ” in this investigation 
has been used to express the measure in which the object of 
a composition, clearly defined in some cases, to bo guessed from 
internal evidence in others, has (in the opinion of the examiners) 
been attained. 

3. The following brief examples were communicated to the 
examiners in our main investigation to illustrate in what way 
it was desired that the word ” sense ” should be utilised in the 
marking of the scripts. 

ExAsrpiE I 

Testimonial to a Typist 

Miss X is a lady who has had a training for many years under skilled 
supervision, and is accomplished in secretarial work of all kinds. I 
regret, however, to say that her spelling is defective, that she is 
untrustworthy in her filing, and that, owing to her lack of general 
education, she cannot write a good letter. 1 hope that, when she has 
worked for a year or more under someone who is able to train her 
properlj', she will be of real use. I may add that she has one uncle in 
Japan, and another in Australia. 

» See The Writing of English, 2nd odn., pp. y and Gl, and Eecord or Message. 
5oth these publications are out of print, but it is hoped to reprint thorn in tho 
some or another form. On this subject, soo the hook by Dr. P. B. Ballard, 
Teaching and Testing English (Univ. of London Press, 1939). 
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2 THK JIAKKI>’G 01- ENGLISH ESSAYS 

Example II 

Extract from an Essay on Games 

Ono of the groat advantages of school games is that they give players 
the capacity to act cooly in^_aja:ysis. 

4. Let us take first Example I. • • i- v. 

One experienced and highlj’’ qualified examiner in English 

(not one of the team employed in our actual investigation) vas 
frank enough to say that his first impulse was to mark the 
nonsense contained in the Testimonial to a T^^iist with an 
alpha ; and he said afterwards “ I still should have given it a 
high mark because the person who uTote that could vTite good 
sentences in English.” 

5. The point is crucial. Our examiners and teachers have spent 
so much time in teaching pupils to write sentences that the 
majority do not realise that by the ago of sixteen it is time to 
consider whether the combination of the sentences makes “ sense. 
When there is a conflict between “ sentences ” and “ sense ” the 
sentences have it every time. And, if this is the view of teach^ 
and examiners, is it to be wondered at that it also comes to be 
the view of many otherwise intelligent but docile pupils 1 
situation was naively and strikingly revealed by an Enghsn 
mistress at a secondary school, when she said, not long ago, to a 
bright girl of fourteen with a mind of her own, “ You are too 
sensible to write a good English composition.” 

6. We come to Example n, taken from an actual schoolboy 
essay — “ One of the great advantages of games is that they 
give players the capacity to act cooly in a crysis.” Here the 
spelling does, we may confess, give a shock, but the sense of the 
passage is irreproachable. 

In the marking of a composition as a whole for the element 
“ Sense ” nothing should be deducted for a sentence of this kind. 
But there is little doubt that with most examiners the faulty 
spelling would influence not only the marks for spelling but those 
for “ General Impression ” ; and some might on the strength of it, 
even condemn such a ivriter as “ illiterate a point with which 
we shall deal later. 



CHAPTER II.— PRELIMINARY INVESTIGATION 


7. A preliminarj' investigation on the marking of essays by 
school children of from I 3 to 16 was conducted in 1936 and the 
following outline scheme was adopted, 

• (i) The main object of the present investigation is to dewso, if possible, 
a method of marldng English compositions which shall have both 
greater “ validity ” and greater “ reh'ability ” than the present methods. 
A word of explanation with regard to the use of these two terms is 
necessary. By “ validity ” is meant the degree of agreement of a 
measurement with the thing moasimjd ; by “ reliabilitj* ” is meant the 
degree of agreement between any two independent sots of measurements 
of the same set of tilings, 

(ii) To quote Professor Spearman, “ the inter-relations of reliability 
and validity are one-sided. Low reliability necessarily involves low 
validity, but the converse is not true, ^^^^erever we find bad agreement 
between diSerent measurements then wo can safely say that the 
examination is bad. But when the measurements agree we can not 
forthwith say that the examination is good.”* 

The low “ reliability ’’ or “ consistency ” of essay -tests is notorious 
(see An Examination of Examinations, pp. 19-32, and The Marks of 
Examiners, pp. 83-92, 117-141 amd 142-147) ; hence, in accordance with 
the principle enunciated by Professor Spearman, the validity of the 
tests is necessarily low. 

It seems possible that by adopting a new method of examining, 
based in part on a new method of teacliing, both the validitj* and the 
consistency of tests in English composition may be increased. 

(iii) Two fundamental questions must be asked in connection with 
all examinatians : — 

IVliat am I really trjnng to test 7 

Am I testing it in the best way possible T 

The examiner, in marldng English essaj^s at stages below the School 
Certificate stage, and up to that stage, has to bear many things in mind 
at once. He is not testing one element at a time, but more like half a 
dozen. He has to think, at least, of Spelling, Punctuation, Vocabulary, 
and Grammar, as well as of the most important element of all — ^the 
sense, and in the competition for consideration, the element of sense 

* The term “ consistency ” wjU bo used below ns a substitute for the term 
“ reliability ” as used bj'- Professor Spearman in his note “ On the Reliability and 
Validity of Measurements ” in the Essays on Examniations, published for the 
Committee (Macmillan, 1936), from which the passage quoted above is 

o - ■' 



4 


THE ilAHKIHG OF ENGLISH ESSAYS 


often comes in easily last. In the present investigation tests Tvill 1>6 
given of two kinds : — 

(1) Class (A) Tests: tests of spoiling, vocabulary, punctuation, 

grammar, etc. _ , 

(2) Class (B) Tests : tests of composition, that is of the power ot 

the candidate to express himself in English for a clearly denned 
purpose. 

Details of Class (A) Tests. — These tests will he of the “ new type, 
i.e. of such a kind as to make the marking mechanical and independent 
of the personality of the marker.^ _ _ , 

Details of Class (B) Tests. — These will bo bsised on principles defined 
by Sir Philip Hartog in the Writing of English and Record or Message, and 
in the chapter on English Composition at the School Certificate Examina- 
tion ; and the “ Write Anything about Something for Anybody ” Theory, 
included in the Essays on Examinations published by the Conamittee. 
In every case the candidate will not only be informed of the subject 
of the composition on which he is required to write, but ho will 
be required to write with a given audience and a given object in vi^- 
He will further be required to make, either before he has written h^ 
composition or after doing so, a plan in the form of heading, 
consisting of not more than ton or a dozen lines. The investigators 
will then be asked to consider how far in their judgment each essay 
is likely to be successful or unsuccessful in attaining the object, taking 
into consideration the audience for whom it is written. A composition 
from the first line to the last must be controlled by the purpose of the 
whole. 


Two small illustrations of this principle may be given. Dot ns 
suppose, for instance, that a boy has been asked to describe a cricket 
match for the benefit of a foreign boy who was never seen one. It 
would be absurd for him to refer to the new l.b.w. rule of the M.C-C. 
without explanation.* On the other hand, if he were writing to describe 
a match for a member of his own eleven it would be equally absurd 
for him to explain what the abbreviations l.b.w. and M.C.C. mean. 

In many cases a small slip in grammar or punctuation or spelling 
would not in any way afiect the success or failure of the composition. 
^ a test for spelling a boy who wrote “ wicheti ” or “ pavillion ” should 
be penalised ; but if he is writing a description of a match to interest 
a fellow-member of his own cricket-team, the vividness and accuracy 
of his description and its general effect would not in any way be affected 
by a mis-spelling of this kind. Nor would it be affected by small slip® 
deduction should be made for a sentence like this : 

Neither of the batsmen were worried by the fast bowling.” But the 
descnption would be affected if the sentences were confused and 
unintelligible. 

It is proposed in some tests to take into account the merits of the plan- 
- It,,?™! remembered that the plan must be subordinated to the 
f,! .ilf ‘ purpose of the composition. No doubt the best general rule 
a cncket-match is to begin with the beginning. But m 
special circumstances it might be defensible to begin with a description 

*F^r “• tests ” is used later in this book. _ „ 

are ablations fo. -of T I’® stated that " l.b.w.’ ’ and “ M.C.C.; 

re<ipoctivoly. ^ before the wicket”, and “ Marylebone Cricket Club » 
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of Eorao particularly striking opisodo and to work backwards and 
forwards from this point. 

In tho first im-estigation it is proposed to len\"o tho investigators 
free to inark by impression and to comparo their marlrs with thoso of 
other investigators acting in tho snmo waj-. A discussion of tho 
results may load to more closely defined conditions of marldng, and 
to a further comparison of marking by impression with marldng by 
details (o.g., abundance of material, general structure, clearness of 
sentences, originalitj- of expression). 

8. The Class A tests were devised by Dr. P. B. Ballard and 
dealt with (i) synonyms (50 items) ; (ii) antonyms or “ opposites ” 
(50 items) ; (iii) spelling (30 items) ; (iv) punctuation and the 
use of capitals (40 sentences or sets of sentences) ; (v) combination 
of sentences (18 exercises). 

9. The Class B tests were as follows : — 

(1) tVrito a paper on tho following subject as if for a school debating 
society : — 

Has a person tho right to spend his (or her) omi monoy as ho (or 
sho) pleases ? Your object should bo to state tho arguments on both 
sides BO that tho society may clearly understand tho position ns you 
see it. You should illustrate your views by concrete examples. 

(2) Describe a game of cricket (or hookey) as if you wore writing for 
a French boy (or girl) who understands English, but has never seen the 
game played. Trj' to make your description lively ns well ns accurate, 
so that ho (or she) may be interested in what you have to toll him (or her). 

(3) You have seen your friend Bob (or May) oS by liner to America. 
Write a description of tho scene either (1) for a newspaper, omitting 
personal details, or (2) for a friend, Tom (or Lucy), who is also a friend 
of Bob (or May). 

Before you begin tho actual description, you are to state in a separate 
paragraph tho precise object of your description, and for whom it is 
intended. 

(4) You are interested in tho career of a boy who is gifted but poor, 
and rmable to go to a University without help. You are to write a 
letter as if to a wealthy friend (man or woman) asking if ho (or she) 
will pay for tho education of tho boy, or lend liim the monoy for it on 
tho undertaking that ho will pay tho whole or a portion back at a later 
stage. You are to say in what way, if any, you are yourself helping 
the boy. 

If you prefer it, you may write on behalf of a girl instead of a boy. 
You are to give names to the boy or girl on behalf of whom you write 
and to tho person to whom you write. 

10. It Avas obvious from preliminary correspondence that the 
scheme, asldng for a period of 21 hours for the writing of 
the essay, made too great demands on the schools to ensure the 
co-operation of any large number. A local education authority 
consented to allow schools imder its control to be approached 
with a view to co-operation on condition that the source of any 
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scripts supplied should not be divulged, and that the chief 
inspector should see beforehand anv report on the work which 
It was proposed to publish. 

11. The following schools under this authority took part in the 
investigation : — 

1 central boj-s’ Bchool* ... School (a) 

1 senior girls’ school* ... School (6) 

1 senior boys’ school* ... School (c) 

1 secondary girls’ school ... School (d) 

In addition, the help was enlisted of two well-known public 
schools-^ne girls’ school (c), and one boys’ school (/). A third 
oys public school (g) also offered its co-operation, but sent in 
1 s results too late for use. The essa 3 's in each school were, with 
one exceprion, marked (by impression) by one or more of the 
school staff; certain of them were also marked by outside 
exammers, mcluding Dr. Ballard and the Director, and the essays 
^ one school, besides being marked by a member of the stafi, 
T? by Wo members of the staff of another school. 

® tabular statement below shows the details of this 
prelmunary mvestigation (objective and essay-tests) 

School Age Group ‘ -- 


(a) 

(t) 

(c) 

(d) 

(e) 


12-6— 136 
12*6 — 13*6 

12— 13 
12*6 — 13*6 

13 — 15*6 


(/) 13*6—15 


Approi. h*o. 
oi scripts ior 
each ol the 
C objectire 
tests. 

40 
40 
40 
40 
51 = 

43' 

40 


Xo. ot 
essay- 
test 
scripts 

37 

39 

36 

30 

43 

35 

220 


Eobject 
Knmber 
ol essay, 
test 

3 

3 
2 
2 ‘ 

4 


No. of 
indlridual 
markings 
for " sense " 
ol essay-test. 
2 
6 
2 

3 

4 


No* of . 
indlridnat 
marking f« 
** sentences 
of essay-test. 
2 
6 
1 * 

3 

4 


220 

■A • , “go-groups, aad of the metliods o£ 

b^acontS.utedby°anir^S?^„'^^^ H + who have 

kinds selective and non-^ecUve if? primary schools. They are of two 
“ competitive exa^a ti^ ^^dren enter the selective central 

..ot till they are 154 - 'ph- " ®Pccial place ” examination! 

* schools. ‘Belective central schools come within the 

the ages of 11 + to “14 school attended by children fro® 

“°t bin ^ted their earlier educatiii at a primaiT 

“hi? ^ of higher educatii. such 

s pupils were allowedto^e^^^®'^ special difficulties. 

' (bi) offi^ a game of net-baU instead of cricket. 

Tests (IV) and (V) only. 
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marking proposed by other investigators, the Director came to 
the conclusion that though it might be possible to attain some 
degree of consistency by confining attention to details of style 
(“ sentences ”) — a method which Dr. J. H. Steel and hlr. Tahnan^ 
seem to have pushed to its limits — consistency would be attained 
at the expense of vahdity, if the object of vTiting is to convey 
“ sense ” (see paras. 2-6 above). 

14. He also came to the conclusion that the subjects were on the 
whole too difficult for pupils from the three schools below the 
standard of secondary schools, and that there was no possibility 
of marking them in any satisfactory wa}’’. The essays from the 
secondary schools were certainl 3 '^ better than those from central 
and senior schools, hut it was noteworthy that the boys from 
a secondary school who dealt with subject (1) had little notion 
of giving arguments on two sides of a question. The descriptive 
subjects. Nos. (2), (3), and (4), set out in para. 9 above were far 
more fruitful. 

15. The results of the investigation suggested, first, that the 
attainments in EngUsh of most school-children of from 12i to 
13i were too elementary to be tested satisfactorily by an “ essay ” 
test, and, second!}'', that in order to yield useful results any 
investigation of this kind should be made on pupils of a 
homogeneous group educated at schools of the same kind. 

This led to the decision that the next investigation should 
be made on the work of boys and girls who were preparing for a 
School Certificate Examination and intended to take that examina- 
tion within a year of the date of the essay-tests.^ 

^ In their book on T/w ili‘ar^‘^n5r of English Composition (Nisbet & Co., ID36). 

* The following examinations have been approved as First School Examinations 
by the Board of Education : — 

The School Certificate Examination of the Oxford and Cambridge Schools 
Examination Board ; 

The School Certificate Examination of the Oxford Delegacy for Local 
Examinations ; 

Tlie School Certificate Examination of the Cambridge Local Examinations 
SjTidicate ; ... * 

The School Certificate Examination of the University of Bristol ; 

Tlio School Certificate Examination of the University of Durham ; 

The General School Examination of the University of London ; ^ 

The School Certificate Examination of the Northern Univereities Joint 
Matriculation Board ; 

The School Certificate Examination of the Central Welsh Board. 

On the origin and general structure of these examinations, see (1) the 
Government Report of which the full title is given in footnote (^) to para. 106 
below ; (2) “ Secondary School Examinations and the Curricula of Secondary 
Schools, with suggestions for reform,** by Sir Philip Hartog, published by the 
National Union of Teachers, 1937; and (3) A Conspectus of Examinations 
(Macmillan & Co., 1937), published for the Committee. 



CHAPTER m.— INVESTIGATION ON THE I^IARKING OF 
ENGLISH ESSAYS, APPROXIMATELY OF SCHOOL 
CERT IFICATE STANDARD, AND THE RELATION OF 
THE jMARKS to THOSE AWARDED FOR CERTAIN 
OBJECTRTE TESTS 


Nature of the School Population Tested and Desceiptio^ 
OF THE Tests Applied 

16. As a resTilt of the experience of the preliminary investigation 
esc^ed above, it -was decided that the essays investigated 
o ■written by pupils "who were taking the School 

Lertifirate Examination within a year of the test. The schools 
selected comprised 13 boys’ schools, 9 girls’ schools, and 4 mixed 
schools ; and, irith one exception, they were all secondary schools 
under ^cal Education Authorities. In a few instances schools 
predated parallel classes for the test. The total number of 
mdividuals who took part in the test was 1164, of whom 651 

examination was 

S corivemence of the schools, over several weeks ; 

Sin? W accidental causes, a number of the pupils were 

period by the schools over a 

time-table-' clacL" tmdue disturbance of school 

preparation of other examinations, 
SscrSedT.i.f 329 girls did aU the tests 

intelligence test ^ essays and four objective tests and an 

Average age of the pupils 

was approiSSyTeVye^i?.^''^^ 

Trluch it iras conveyed. ^ exceptionally high marks for the school to 
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Subjects of the six essay-tests, directed and ^mdirected, and 
time aUoived 

18 . In the Preliminary Investigation (see Class B tests, page 
i above) tbe pupils were required to write not only on a given 
subject but with a given audience and a given object in view. 
We have called such subjects “ directed ” subjects, as contrasted 
with the “ imdirected ” subjects, mainly set at School Certificate 
examinations, complying unth the general formula " Write 
anjdhing on something for anybod}’-,” in which the only thing 
defined at the examination is the “ something.” 

Each pupil was required to -write an essay on each of the same 
six subjects. Of these three were “ imdirected ” subjects which 
had been actually set at a School Certificate examination -within 
a reasonable interval from the test, and three were “ directed ” 
subjects derived from the “ undirected ” subjects. 

The foUo-wing essay-subjects, three imdirected and three 
directed, were selected for the investigation, -noth the approval 
of the main Committee : — 


Undirected 


A The right place of games in school life. 
B In praise of England. 

C A school speech-day. 


Directed 


' A1 Should games be regarded ns a duty or a pleasure ? 
Give pros and cons, ns if you -were arguing the 
case in a speech to a school debating society, and, 
if possible, come to a conclusion. 

B1 A French friend of your own age has told you 
in a letter that most French people consider 
their own country the best in the -svorld, and 
asked you if Engh'sh people think tbe same of 
England. You are to -write in reply telhng your 
friend in -what respects you yourself tliink England 
is superior or inferior to any other coimtry or 
countries. 


Cl Describe a school speech-day at -wliich you have 
been present ns if you were -writing to a boy (or 
girl) of your class -who has been prevented by 
illness from being present. Make your description 
^ ns interesting and li-vely as you can. 

Each pupil was required to -write an essay on each subject. 
The subjects were therefore so chosen that the pupils might all 
reasonably be expected to have something of interest to say on 
each of them ; while such topics as “ Gossip,” “ Gardens,” 
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and “ Trees,” all of n'liich had been set in ft .iy recent Schoc 
Certificate Examination papers, were avoided. 

The time allowed for each essay was one hour, a peno< 
frequently allowed at School Certificate Examinations, and i 
was arranged that the undirected essay -subject should be set n 
each case before the corresponding directed essay-subject, afl' 
that the interval between the setting of the two related subject 
should be in each case not less than three weeks, so as to avor 
mere repetition. 


Length of essays 

19. The average, minimum, and maximum number of wor^ fo 
the essays on the different subjects, as shown in a sample consistiflo 
of the essays of 20 candidates chosen at random, were as follows 


Essay-subject A 
Average number of words 559 
AUnimum „ „ 370 

Maximum „ „ 770 


B 

570 

260 

1000 


C 

677 

350 

930 


A1 

659 

340 

860 


B 1 

550 

200 

970 


Cl 

570 

320 - 

1080 .- 


Method of selection of the material for investigation^ 


JUT 

20 . In order to bring the cost of the investigation within 
reasonable limits, it was decided that the final markings of the 
examiners (exclusive of the marking of trial-scripts ; see paras. 
27 and 30-33 below) should be limited to the 600 essays of lO® 
candidates, 50 boys and 60 girls, selefited from the whole number 
m such a way as to provide an approximately “ normal ” diS' 
tnbution of merit (see para. 39 below). For this purpose the 
essays were marked in the first instance by the school-teachers 
ot the pupils and them marks were furnished with the essays. 

method they pleased in this pre- 
then marks for each boy and each girl 

of 50 boys and of 50 girls were 

corresp^ded to 

Tm ft ” frequency curve. The &mnnttee 

of the the helpf^ess of the local authorities and 

the schools concemed!^*^ headmistresses and English teachers of 

of fiio teachers were not 
of them excent tba^i ®^®'?“ers and that no other use was made 
of scripts. ^ described above for the preliminary selection 

» This subject is also dealt with in para. 39 below. 
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and Trees,” all of wbich had been set in fc .iy recent School 

papers, were avoided. 

The time allowed for each essay was one hour, a peri(^ 
irequently allowed at School Certificate Examinations, and it 
was arranged that the undirected essay -subject should be set in 
each case before the corresponding directed essay-subject, and 
t between the setting of the two related subjects, 

so d be in each case not less than three weeks, so as to avoid, 
mere repetition. 


Length of essays , 

19. The average, minimum, and maximum number of words for/ 
nf different subjects, as shown in a sample consisting 
ot the essays of 20 candidates chosen at random, were as foUows :- 


Essay-subject 
Average number of words 
Alimmum „ 

Maximum ’ ” 


A 

B 

C 

A1 

B1 

Cl 

659 

570 

577 

559 

550 

6/0 

320 

370 

250 

350 

340 

200 

770 

1000 

930 

860 

970 

1080 


Method of selection of the material for investigation^ 

reaso"nSi1p°liW+ cost of the investigation, witl^ 

that the final markings of the ^ 
27 and 30-^a marking of trial-scripts ; see paras. 

canSate^' 50 b 600 essays of f 

in suS' a ’ 60 girls, selefited from the whole number, 

tribution of me -f an approximately “ normal ” dis- 

this purpose the 

of tL pupils and^+b“^ mstance by the school-teachers 

They wer^Siowi furnished with the essays- 

liminary markinsr Tb^^^ method they pleased in this pre- 
then added toaefhpr b»oy and each girl were 

selected so th^ the 60 boys and of 50 girls were 
what is known as the ^ ^°bh cases corresponded to ■ 

are much indebted for +b .^^^’^oocy curve. The Committee , 
of the headmasters nud b of the local authorities and 

the^schools concerned ^ ireadmistresses and English teachers of 

communicated to oiu^p^q^- marks of the teachers were not 
of them except that despn'b^^^l^^'^ other use was made , 

of scripts. described above for the preliminary selection ^ 

■ ~b,„t „ .i,. , 
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and “ Trees,” all of wMcli had been set in fc .iy recent School 
Certificate Examination papers, were avoided. 

The time allowed for each essay was one hour, a period 
frequently allowed at School Certificate Examinations, and it 
was arranged that the undirected essay-subject should be set in 
each case before the corresponding directed essay-subject, and 
that the interval between the setting of the two related subjects ' 
should be in each case not less than three weeks, so as to avoid 
mere repetition. 

Length of essays , 

19. The average, minimum , and maximum number of words for 
the essays on the different subjects, as shown in a sample consisting 
of the essays of 20 candidates chosen at random, were as follows : — 


Essay-subject 

A 

B 

C 

A1 

B1 

Cl 

Average number of words 

559 

570 

577 

559 

550 

570 

Jlinimum „ „ 

370 

250 

350 

340 

200 

320 

Maximum „ „ 

770 

1000 

930 

860 

970 

1080 


Method of selection of the material for investigation^ 

20. In order to bring the cost of the investigation within 
reasonable limits, it was decided that the final markings of the 
examiners (exclusive of the marking of trial-scripts ; see paras. 
27 and 30-33 below) should be limited to the 600 essays of 100 
candidates, 50 boys and 50 girls, selected firom the whole number 
in such a way as to provide an approximately “ normal ” dis- 
tribution of merit (see para. 39 below). Eor this purpose the 
essays were marked in the first instance by the school-teachers 
of the pupils and their marks were furnished with the essays. 
They were allowed to use any method they pleased in this pre- 
liminary marking. The marks for each boy and each girl were 
then added together, and those of 60 boys and of 50 girls were 
selected so that the set of marks in both cases corresponded to 
what is known as the “ normal ” firequency -curve. The Committee 
are much indebted for the helpfulness of the local authorities and 
of the headmasters and headmistresses and English teachers of 
the schools concerned. 

It should be added that the marks of the teachers were not 
communicated to our examiners and that no other use was made 
of them except that described above for the preliminary selection 
of scripts. 


* This subject is also dealt -with in para. 39 below. 
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Mechanical reproduction of the scripts 

21. It was originally desired to reproduce the scripts by 
photography for simultaneous marking by the different examiners. 
This method of reproduction had been used in dealing with the 
scripts in French and Chemistry in earlier investigations. ^ The 
cost would, hoAvever, have been six times that actually incmred 
by maldngwbat are known as" Ormig” master-copies in typescript 
and rolling off the number of reproductions required while it 
was estimated that stencilled copies would have cost twice as 
much as the Ormig reproductions. It is of course true that a 
typed reproduction does not present to the examiner the 
i^osyncrasies of the pupil’s handmiting, but in the present 
instance the handuTitings were on the average so good and clear 
that few deductions of marks would have been made by any 
examiners on account of misunderstandings due to illegibihty. 

The typists were instructed faithfully to reproduce the mistakes 
in spell^g and punctuation of the originals. The chief slips (very 
few in all) made by the typists were due to their involuntary 
corrections of mistakes. The reproductions were carefully com- 
pared with the originals and even if any slight oversight 
accidentally escaped attention in this process it would not 
significantly affect the validity of the investigation, since it was 
not the capacity of individual candidates but the consistency of 
the markings by different examiners that was being tested. 

Nature of objective tests 

22. The objective tests used were as follows : — 

Test 1 Group-Intolligence Test, series 33 o£ the National 
Instituto of Indnstrial Psychology (193 items) 

Test 2 Opposites (35 items) 

Test 3 Spelling (40 items) 

Test 4 Punctuation and the use of Capitals (58 items) 

Test 6 AVord-iJIeaning (2C items) 

The objective tests were intentionally made short so as not 
to make too great demands on the time of the schools. 

' See .4)1 Examination of Examinations, pp. 17-18 ; and The Marks of 
Examiners, paras. G7 and 98. Since this work, the cost of reproduction by 
photostatic and other photographic methods may havo been reduced considerably. 

' The firm manufacturing the “ Ormig ” machine in England is Block & 
Anderson, Ltd., of 30, Farringdon Street, E.C.4, to whom the Committee are 
indebted for tlieir helpful assistance in obtaining good results. The capacity of 
a typist who is inexperienced in making “ Ormig ’’ master-copies cannot be 
assmned, but it is not difficult to train a typist for this purpose. A sufficiently 
hoat’y touch is essential. 
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Tests 2 to 5, reprinted in Appendix I (pp. 157-163 below), w^ere 
devised by Dr. Ebblewbite Smith on the basis of those devised 
by Dr. Ballard for the Preliminary Investigation (see para. 8 
above) and modified in the light of the results of that mvestiga- 
tion. They were then finally settled after criticism by the 
Sub-CJommittee referred to in para. 24 below. 

“ Opposites ” Test. — The questions used in the “ Opposites ” test 
were designed to measure the extent of vocabulary of the 
candidates ; and the type of intelligence test question which 
tries to lure the candidate into underlining the wrong word was 
avoided. 

Spelling Test. — ^The ordinary objective spelling test has two dis- 
advantages : 

(a) that the word is submitted to the testes without any context 
indicating its meaning, (6) that the correctly spelt word is accom- 
panied by several misspellings which tend to confuse him. 

The ordinary dictation test, on the other hand, has the disadvantage 
that it is wasteful of time, since the testee is obliged to write down 
many superfluous words (for instance, “ the,” “ that,” “ in,” 
“garden”), which 100 per cent, of the testees can certainly spell 
correctly. 

The method used in the investigation has the advantage of the 
ordinary dictation test without its disadvantages. It will be seen 
from the test-paper that it consists of a number of printed sentences 
with a space in each left blank for the word which the testee is required 
to spell ; that the supervisor in administering the test reads the 
completed sentence aloud twice at a moderate rate, and that the 
testee writes down only the “ missing ” word. 

Punctuation Test. — ^The great difficulty with punctuation tests is to 
devise one which it is easy to score rapidly. In the test used this 
difficulty is got over by providing that in each line of the passages 
printed there shall be one mistake or omission and one only. 

It is to bo pointed out that the testee is not necessarily able to 
discover the mistake or omission by looking at each line in isolation. 
Thus in the first line of the first passage a parenthesis is omitted 
before the word “ which,” but it is only after reading the next 
line that the testee can discover that it is a parenthesis-mark, 
and not a comma, which has been omitted. 

Procedure adopted for the marhing of the essay -scripts. 

Personnel of the Board of Examiners and of the Sub-Gommittee of 
the main committee by whom the marking-scheme was devised 

23. The eight examiners (four men and four women) who 
actually marked the 600 essay-scripts (which were selected as 
explained in para. 39 below) had all had several years’ experience 
in examining at the School Certificate standard, either as chief 
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examiners or as assistant examiners, or both, and had been 
recommended by persons acquainted m'tU their work, ‘ 

In the Preliminary Investigation described above the examiners 
■were unpaid, but in tliis investigation, as in the others carried 
out under the auspices of the main Committee, the examiners 
•were paid in accordance -with the usual scale adopted for the 
marldng of scripts of the same Idnd and for attendance at 
examiners’ meetings, or, in respect of some details, on a scale 
slightly higher. It might have been possible, though not easy, 
to secure for our purpose the voluntary help of a team of 
competent examiners ; but marldng by voluntary helpers would 
have been carried out under conditions different from those of a 
real examination. In an investigation of this kind it is to be 
remembered that the actual task of marking examination scripts 
is for most examiners -wearisome, and the psychological condition 
of a person who is rnipaid for performing such work is lilmly to 
bo different from that of a person who is adequately paid. 

24. The detailed plans for the investigation were settled by a 
Sub-Committee, working at the later stages in conjimction ■adth 
the examiners, as will be explained below. The Sub-Committee 
consisted of Dr. P. B. Ballard, Professor H. R. Hamley, Dr. 
Percival Gurrey, Head of the Dmsion of English in the Universitj' 
of London Institute of Education, and Dr. C. Ebblowhite Smith, 
Lectmer in the Postgraduate Division of the Institxite,* -with the 
Director as Chairman. 

In planning the investigation the Sub-Committee had the 
benefit of the advice on statistical matters of Professor H. R. 
Hamley and Dr. Ebblewhite Smith, who bad in mind the 
subsequent treatment of the results by the factor analysis method 
and the analysis of variance. The actual statistical analysis was 
carried out by Dr. Ebblewhite Smith, who was assisted by his -wife, 
and, in the parts dealing -with variance and factor analysis, by 
Dr. R. W. B. Jackson.® Several himdred correlation coefiicients 
w'ere calculated for the Committee by the Scientific Computing 
Service, Ltd., Bedford Square, London, W.C. Dr. Smith is 
responsible for nearly the whole of the final form of the Statistical 
Section of the Report. 

25. The main object of the essay investigation was, as stated 


» Thoir nnmes liavo been treated as confidential. The individual examiners 
are referred to in this report ns P, Q, B, etc., and always in the masculine gender. 

- Eecently appointed Associate-Professor of Education in the University of 
Manitoba, Canada. 

* Now Research Assistant, Department of Educational Research, University 
of Toronto, Canada. 
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above, to ascertain whether “ directed " essays, that is, essays 
written with a definite object and audience in view, would yield 
not only more valid results but more consistent scores than 
essays WTitten in accordance “with the “ write anything about 
something for anybody ” formula, in which only the “ something ” 
is defined. 

Each of the examiners was informed of the arrangements 
which had been made with the schools, and was furnished, like 
the examiners for the preliminary investigation, with a copy of 
Record, or Message and an offprint of the essay by the Director on 
composition in English in the volume of Essays on Examinations 
published by the Committee.^ The Director also fiumished them 
with an introductory and preliminary memorandum dealing not 
only with “ sense ” but suggesting categories of details under which 
marks might be allotted. 

26. In accordance with the traditional practice, the marking 
scheme was finally settled after the marking of trial-scripts by 
the examiners concerned, but the number of trial-scripts employed 
was exceptionally large (see para. 33 below), and the discussions, 
both oral and written, of the preliminary results, were exception- 
ally detailed. 

Four meetings in all, each consisting of two sessions of approxi- 
mately three hours, were held jointly by the examiners and the 
Sub-Committee : two on January 15th and February 12th, 1938, 
to discuss the marking of trial-scripts, one on March 31st, after 
500 out of the 600 scripts had been marked, and a final meeting 
on July 16th, after all the 600 scripts had been marked in the 
ordinary way. At this final meeting the examiners discussed the 
preliminary results submitted by the statisticians, re-marked 14 
clean Ormig copies of scripts that had been previously marked, 
and made suggestions for future marking schemes, on the basis of 
the work done. In the course of the work 16 memoranda or 
reports were famished by the Director, containing either in- 
structions for marking, or summaries of discussions at meetings, 
or of written reports of individual examiners, or of replies to 
questionnaires addressed to the examiners on various points. 
Only the major points in the procedure and decisions arrived 
at are set out in this report. 

27. Trial-scripts. — ^Before the first meeting each examiner 
received 20 trial-scripts for preliminary marking on each essay- 
subject, 120 in aU. Of each set of 20 trial-scripts 17 were original 

^ See Essays on Examinations : English composition at the School Certificate 
ux&mination ; and the "Writ© anytliing about Somotbing for Anybody ” theory. 
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scripts, different for each examiner, and 3 n-ere Ormig copies, 
the same for all the examiners. The object of these scripts was 
to familiarise the examiners ndth the material and to provide 
a common basis for the discussion of a marking scheme. 

_ 28. Categories 7mrkcd, and Scale of Marking. — ^After the first 
discussion in connection with these trial-scripts, the examiners 
and the Sub-Committee decided that each essay should bo marked 
for the following categories ; — 

(I) Sonso ; (11) Spoiling ; (III) Punctuation, including Formal 
Paragraphing ; (IV) Grammar ; (V) Vocabularj- ; (VI) Sontonco 
Structure ; and (VII) Gonoral Impression ; 

and that the mark for General Impression should be allotted after 
the other categories had been marked. 

The question of the scale of marking was then discussed ; no 
one was (if we remember right) in favour of a 100 point scale. 
At the suggestion of Professor Hamley a 15 point scale was 
adopted in the following form : A-f-, A, A—, B-f, B, B— , 
C-b, C, C— , D-f, D, D— , E-b, E, E— . This may be considered 
as a refinement of the five-point scale. It has been used for 
many years in the University of London Institute of Education, 
and in London training college examinations. 

It was also decided that marks were to be given by means 
of general estimates and not by means of negative marks for 
mistakes and positive marks for “ felicities,” although in practice 
the examiners marked for spelling by means of deductions. 

29. Median mark of scale to denote competency. — ^It was decided 
that the median mark C should be regarded as designating 
conipeteiicy, in other words, the possession of a “ utilisable sldll ” 
in the writing of English. To avoid all misapprehension it is to 
be pointed out that C is the median mark of the scale, not the 
median mark of the candidates.^ 

30. Marking of trial-scripts. — ^Four additional Ormig scripts 
were marked at the first meeting ; and before the next meeting 
12 new Ormig scripts were despatched to all the examiners, who 
were also asked to state whether in their opinion it was feasible 
in dealing with scripts of this kind to ask for marks for “ Plan.” 
The Director, in smnmarising the replies, said that, while he him- 
self regarded the Plan as of the utmost importance in composition, 

* Tho median mark of the candidates is n mark such that the number of 
candidates nrith a higher mark and of those -n-ith a lower mark is the same. 

It is to be noted that there can be no certainty that the median mark of tho 
candidates denotes " a utilisablo skill.” If the capacity of the School Certificate 
candidates to write Greek prose were being tested it is highly improbahle that 
the median mark would denote a utilisablo skill. — 
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he had refrained from asking the pupils to append to their 
Tvork a brief summary or plan for two reasons : (o) because 
so many of them were unaccustomed to make plans or summaries, 
(6) because the time allowed for rvriting (1 hour) was so short. 

The 12 OiToig trial-scripts marked by the examiners were 
returned to each of them with the marks of all their colleagues, 
and with the request to revise them if on second reading they 
thought fit. But the revisions were few. 

31. At the second meeting a detailed discussion took place 
on the 12 trial-scripts circulated after the first meeting, and 
on the revised marks which had been allotted by the examiners 
after seeing the marks of their colleagues ; and three decisions 
were reached with regard to the marking-scheme : — 

(i) To make the marking for “ Plan ” optional, it being left to 
examiners who found the column useful in arriving at a mark for 
General Impression to avail themselves of it. 

(ii) In marking for Spelhng, to allot marks only for the first 
two pages (in order to avoid penalising a pupU by reason of the 
length of his composition), and to mark down essays of less than 
two pages according to a settled scheme. 

(iii) To provide a column for the marking of Literacy. 

32. 3Iarking for Literacy. — ^After long discussion it was found 
impossible to agree on a definition of Literacy (see paras. 106-9 
below) ; but the column was inserted in order to see if the marks 
would disclose any general agreement in valuing \mder this head. 

33. At this meeting each examiner also marked 13 Ormig trial- 
scripts ; and, after scrutiny of the marks, the statisticians were 
of opinion that the marking of the 600 scripts should then 
proceed. It will be seen that before beginning to mark the final 
scripts each examiner had marked 149 trial-scripts of which 47 
were Ormig scripts, identical for all examiners.^ 

34. MarkiTig-sheets ; marhing for Literacy. — ^The marking-sheets 
for the 600 scripts were printed in the form appended (Appendix 
H), and for the use of the statisticians “ assembly-sheets ” of 36 
pages for each essay-subject were drawn up showing side by side 
the marks allotted by each examiner for each category. In all, 
about 36,000 marks were allotted in this first part of the investiga- 
tion. Por the purpose of statistical calculation the literal marks 
E — to A-~, were converted into the series 1 to 15, the median C, 

^ One examming authority has experimented by making the examiners correct 
6 to 8 photographed scripts, identical for all examiners. It has published 
resvdte in eome subjects but not any record of the discrepancies of the marks in 
English, a significant omission. (See The Marks of Examiners, paras. 658-669.) 
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designating Conipetenc}”, being rendered by 8. Only two 
examiners used the eolumn for Plan to any great extent, and 
these marks have not been analysed statistically. The marks 
for Literacy were not inserted numerically, but as either “ Yes,” 
“ No,” or “ Doubtful.” (See the chapter on Literacy, p. SO below.) 

Opinions and Eccommcndations of the Examiners 

35. In response to a ivritten questionnaire the individual 
examiners expressed their opinions on various points wliich had 
arisen in the course of the investigation. 

Thc}”^ were unanimous in thinldng that the method of marking 
by categories was superior to the methods which they had 
previously used, though it demanded more time. The ordinary 
method, said one examiner, “ requires an almost impossible 
balancing of the different qualities of an essay one against 
another” ; and a second examiner added, “ \vith this method the 
mind is kept more alert and balanced in judging the various 
elements of the composition.” 

They aU agreed in regarding the category of “ Sense ” as of 
great value. The majority were decidedly of opinion that a 
“ directed ” essay-subject yielded an essay of better quality than 
the corresponding " undirected ” essa 5 ’^-subject, and that it could 
be-marked with greater confidence. Though there was a variation 
of opinion on these points, no examiner expressed the view that 
“ directed ” essays were harder to mark than “ imdirected.” It 
was agreed that the quality of an essay, ” directed ” or " im- 
directed,” depended largely on the terms in which the subject 
was set. 

There was a consensus of opinion that subject Al, a “ directed” 
subject (asking for pros and cons in an argument), was too hard 
for the majority of the writers, and this view is borne out by the 
marks allotted. (See Table III, pp. 30-31 below.) 

The Director, while of opinion that " directed” subjects should 
be set, expressed the view that under existing conditions it 
would be impossible to plough a candidate for irrelevancy, if 
he wrote a piece of decent English, because the training in 
English composition was in many schools so unsatisfactory. He 
himself would have no hesitation in ploughing a candidate for 
irrelevancy, if it did not, as at present, mean a plough on the 
examination as a whole, and if the candidates were allowed to 
take the subject of English composition separately on a subsequent 
occasion. The majority of the rx^tingr'- -VVwith this view. 
One examiner stated that at * bertai^ ' 'H *tion assistant- 
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examiners were instructed to pass 60 per cent, of the candidates ' 
with “ credit ” ; in such circumstances it would he impossible to 
plough a candidate merely because he did not comply with the 
rubric at the head of the examination paper. 

- 35a. The whole question of categories was discussed again in 
great detail, and the question was considered whether it would 
be possible to assign a final mark bj’^ “ weighting ” the marks in 
the various categories and adding these together. No agreement 
was reached on this particular point ; but the following recom- 
mendations were made : — 

(1) That in the marking of essays the following categories and 
scale of marks should be used ^ ; — 


(i) “ Sense,” with a 15-pomt scale A +, to E — , C denoting coni' 
petency. 


(ii) Spelling 




(iii) Punctuation (Including Formal Paragraphing) 

(iv) Grammar and Syntax 

(v) Accuracy of Vocabidary (the examiner bearing 
in mind only whether the words are used 
correctly or incorrectly) 


with an 8-point 
scale, C to 
V E C 
I denoting 
I competency^ 


(vi) Power of Expression, to cover (a) felicities of 

vocabulary, and (&) Sentence Structure 

(vii) General Impression 


'v with a 15-point 
scale, A -1- to 
■ E C 
denoting 
J competency 


(2) That the marks for ” Sense ” should be kept distinct from 
those in any other category. 

(3) That, without any arithmetical weighting, the examiners 
might, as in the present investigation, form their estimates of 
“ General Impression ” after considering their awards tmder 
categories (ii) to (vi) inclusive. 

35b. The examiners agreed generally that the marks which they 
had awarded under the heading “General Impression” corre- 
sponded to the final marks they wonld have awarded at a School 
Certificate examination, supposing that they had heen free from 
the obligation to pass or give credit to a stated percentage of 
candidates. 

^ The Sub-Committee are not in complete agreement with the recommendations 
of the Examiners on the scales of marks to be used in marldng categories (ii) 
to (v) above. On this point, see para. 169 (i) below. 
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lie-marking of 120 scripts 

36. In order to investigate tlie “ self-consistency ” of the 
examiners the Suh-Committee decided to ask them to re-examine 
20 scripts for each essay-subject (120 in aU), after an interval 
of about five months from the completion of the original marking, 
and under precisely the same conditions in all respects as those 
of the first marldng ; and this was done. No previous notice 
of the request was given. The original numbers on the scripts 
were removed, and they were re-numbered so that it was im- 
possible for them to be identified in any way with scripts 
previously marked. The actual choice of the 120 scripts to be 
re-marked was left to our statisticians. On the results of the 
re-marking see paras. 44, 96-105, and 117—122, below. 



CHAPTER IV.— STATISTICAL REPORT 

By 

De. C. EBBIiEWHTTE SaHTH 

Note . — The general reader is advised to omit this chapter on a first reading.^ 

37. The experimental methods used in this investigation and 
the "way in ■which the “ ra'w ” data submitted 'to statistical analysis 
have been obtained are described in Part HI above. 

38. It is, however, desirable to recall here the main facts. 
1164 pupils of secondary schools, boys and girls, aU intending 
to take the School Certificate examination within twelve months 
of the beginning of the investigation, took part in it. The com- 
plete examination consisted of : — 

(a) Six essays of an hour each on six different subjects, the 
same for each pupil ; (6) Intelligence group-test Ho. 33 of the 
National Institute of Industrial Psychology ; (c) four other • 
new-type 'tests described in para. 22 above. 

39. In order to avoid rmdue disturbances of school routine, 
the whole examination had 'to be spread by each school over 
several weeks, and owing to the unavoidable absences found to 
occur during such periods it was only possible to submit 770 
pupils in all, 441 boys and 329 girls, to aU the tests.® 

We shall call these 770 individuals the “ large sample.” From 
this “ large sample,” 50 boys and 60 girls, whom we shall call 
the “ small sample,” were selected in the folio-wing way for the 
detailed markings of their essays on the same six subjects (three 
directed and three undirected — ^see para. 18 above).® It was 

^ This part of the book is intended to be self-contained, and was designed, 
within the limits available, to meet the needs both of statisticians and non- 
statisticians. It is realised, however, that while it contains statistical explana- 
tions superfluous for the professional, it may fall short in some places of the 
requirements of the non-statistician who must he referred to the standard 
textbooks on the subject. 

* There is no reason to think that the pupils of any one school became 
acquainted with the tests from the pupils of any other school during the periods 
referred to. 

’ With reference to the selection of the small sample it should he stated that 
in a few cases the Ormig scripts on a given subject by some of the selected can- 
didates were used as trial-scripts find were replaced in the actual investigation by 
Ormig scripts on the same subject written by other candidates who had obtained 
the same average mark from their teachers (see paras. 26-33). In all cases the 
scripts marked by all the different examiners weis of course identical, so that the 
statistical results wore not affected by this substitution. — 
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desired that the essays of the “ small sample ” should provide 
marks Tvhich -would conform approximately to -what is called 
“ normal frequenc3^ ” distribution ; and for this purpose the 
class-teachers were asked to assign marks to the essays of all 
the 1164 pupils in accordance with any method that they deemed 
suitable, before the essays were transmitted to us ; and they did 
so. The essays for the “ small sample ” were then chosen from 
the whole batch in such a way that the series of total marks for 
the six essays of the pupils selected, arranged in order of 
magnitude, conformed to the normal cmrve. This rough and 
ready method was sufficient for tliis particular purpose.* 

40. The intelligence-test scores of the “ large sample ” were found, 
to be distributed about an average (or mean) score of 133 -44 
■nith a standard deviation of 18-87 marks.* There were in the 
“ largo sample ” difEerences both between the means and between 
the distributions of the intelligence-test scores of the boys and 
those of the intelbgence-test scores of the girls. The mean score 
for the boys was 135-68 and the mean score for the girls was 
130-51. The standard deviation of tlie scores of the boys was 
18-33 and that of the scores of the girls was 17-73. 

41. The distribution of the intelligence-test scores of the 
" small sample ” was found to have a mean of 136-00 and a 
standard deviation of 18-61. These values are not significantly 
different from those of the mean and standard deviation of the 
intelligence-test scores of the “ large sample." Sex differences 
were not considered in the “ small sample.” 

42. Bach of the 600 essays written by the candidates comprising 
the “ small sample ” was marked independently by eight examiners 
for seven categories ; (I) Sense, (II) General Impression, (III) 
Spelling, (IV) Punctuation, (V) Grammar, CVT!) Vocabulary, and 
(VII) Sentence Structme. 

A few of the examiners gave marks for the Plan of each essay 
but the number of marks so awarded was not sufficient for 
statistical treatment (see paras. 30-1 above). Marks were also 
awarded by all the examiners for Literacy, but as these were not 

* It will bo remombored that tho marks of the teachers played no further part 
in the investigation. They woro not communicated at any stage to our examiners. 

’ Tho standard deviation is the usual measure of the spread of a distribution 
of marks. It is defined ns tho square root of tho average of the squares of tho 
deviations of marlrs from their mean. Consider tho following example .- 36, 34, 

29, 27, 24 form a series of marks having a mean of 30. Tho deviations from this 
mean are + 6, -h 4, - 1, - 3, - G. The standard deviation a is obtained by 
averaging tho squares of these deviations and obtaining tho square root, i.e., 

„ = ^ 36 -I- 18 +^1 t ± 1 ^ ^ 4.43 marks. 
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given in tlie same form as the marks for the other categories, it 
■was decided to treat them separately. The main task of the 
statisticians "was the analysis of 341 =(6x8x7 +5) sets of marks, 
or 34,100 marks altogether (exclusive of the marks for Literacy ; 
see pp. 80-87 helow), besides the 6720 marks yielded by the 
re-marking (see pp. 60-79 below). 

43. The essay marks were based on a fifteen-point scale ranpng 
firom A-b to E— . For the purpose of statistical maniprJation, 
these literal marks were converted into their numerical equivalents 
(1 to 15). 

For the difierent objective tests the maximum marks were as 
follows : — 


Test 1 


Test 2 

Test 3 
Test 4 

Test 5 


Group Intelligence -test Iso. 33 of 
the National Institute of In- 
dustrial Psychology 

A test of knowledge of verbal 
opposites 
A test of spelling 
A test of punctuation and the use 
of capitals 

A test of knowledge of the meaning 
of words 


Maximum 

193 marks 

35 marks 
40 marks 

68 marks 

26 marks 


44. Ee-marking : — ^For each essay-subject, representative 
samples, each consisting of 20 scripts, were chosen firom the “ small 
sample ” and re-marked independently by each examiner for 
each category (see para. 36 above). Thi provided a further 
(6 X 20 X 8 X 7) = 6720 marks exclusive of the marks for Literacy.^ 
44a. In the text and in our tables, the following numbers will 
be used to designate the different categories : — 


Sense (I) 

General Impression (H) 
Spelling ■ (rH) 

Punctuation, in- 
cluding Formal 
Paragraphing (IV) 


Grammar (V) 
Vocabulary (VI) 
Sentence 

Structure (VH) 


The several examiners -will be designated by the letters P, Q, 
R, S, T, TJ, V, W. 

The three “undirected” essay-subjects are called A, B, C. 
The three “ directed ” essay-subjects are called Al, Bl, 01. 

' The question of marks for Literacy is dealt with in Chapter V, pp. 80-92. 
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45. Tables I and II (1) to II (6) show representative samples of 
the original data in the form in which they were presented for 
analysis.^ 

TABLE I 

Sample Scoiies on Objective Tests 


Cnnd. 

Test a) 

Test (5) 

Test (3) 

Test (4) 

Test (6) 

No. 

(InlclUecncc* 

Test) 

(Uax. 193) 

(Opposites) 

(STax. 35) 

(Spelling) 

(Max. <0) 

(Panctaation 
and Capitals) 
(iTax. 6S) 

(Word- 
meanings) 
C&fax. 26) 

9 

149 

33 

36 

60 

21 

23 

137 

31 

37 

63 

21 

38 

146 

29 

35 

48 

19 

43 

118 

30 

25 

36 

13 

61 

166 

36 

39 

65 

20 

81 

- 162 

32 

36 

46 

18 

6 

110 

29 

40 

49 

21 

13 

132 

31 

36 

64 

18 

52 

136 

30 

31 

33 

17 

69 

125 

31 

34 

56 

11 

69 

86 

22 

27 

44 

8 

86 

167 

35 

37 

50 

19 

11 

134 

31 

40 

61 

19 

22 

138 

29 

39 

53 

17 

43 

118 

30 

25 

36 

13 

45 

156 

33 

37 

61 

16 

68 

137 

34 

39 

51 

21 

99 

167 

32 

23 

50 

11 

4 

138 

31 

37 

56 

20 

12 

171 

31 

38 

52 

23 

68 

137 

34 

39 

51 

21 

80 

117 

30 

35 

63 ' 

12 

93 

124 

28 

30 

45 

11 

98 

84 

25 

28 

52 

13 

o 

127 

26 

21 

49 

6 

32 

124 

33 

34 

50 

16 

35 

152 

28 

38 

49 

22 

41 

143 

32 

39 

53 

16 

93 

124 

• 28 

30 

46 

11 

95 

161 

33 

39 

67 

21 

25 

116 

24 

31 

44 

16 

37 

119 

31 

38 

61 

17 

66 

122 

26 

38 

65 

. 18 

68 

137 

34 

39 

61 

21 

82 

100 

30 

39 

67 

15 

95 

161 

33 

39 

67 

21 


The complete figures are omitted to save expense. 
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THE JUHKING OP ENGLISH ESSAYS 


TABLE n (1) 
Essay-subject A 


Cnnd. Jlarks awarded to Scripts by Examiners : — 


Categorj' 

No. 

P 

Q 

R 

S 

'1 TW 

T 

U 

V 

W 


9 

7 

2 

11 

G 

0 

11 

10 

6 


23 

8 

10 

11 

10 

6 

8 

8 

12 

(I) 

38 

7 

9 

7 

7 

3 

9 

6 

7 

Sense 

43 

4 

4 

6 

4 

3 

6 

4 

2 


61 

12 

11 

12 

13 

11 

12 

12 

12 


81 

11 

12 

13 

7 

10 

12 

10 

13 


9 

7 

7 

10 

G 

6 

11 

10 

8 


23 

9 

10 

8 

10 

6 

9 

8 

11 

(11) 

38 

6 

7 

6 

6 

3 

9 

G 

6 

General 

43 

2 

3 

6 

2 

3 

6 

4 

2 

Impression 

61 

10 

11 

11 

12 

11 

12 

12 

11 


81 

12 

12 

12 

8 

10 

12 

10 

12 


9 

12 

13 

12 

13 

7 

12 

10 

8 


23 

11 

11 

12 

11 

6 

11 

14 

11 

(HI) 

38 

8 

9 

12 

4 

5 

9 

7 

6 

Spelling 

43 

6 

5 

6 

2 

2 

6 

5 

3 


61 

13 

13 

11 

13 

11 

12 

15 

11 


81 

13 

11 

9 

11 

8 

14 

11 

8 


9 

7 

9 

12 

8 

7 

11 

10 

9 


23 

8 

11 

9 

12 

7 

9 

8 

8 

(IV) 

38 

7 

8 

8 

8 

4 

10 

G 

7 

Punctuation 

43 

3 

2 

6 

2 

4 

4 

5 

4 


61 

9 

11 

12 

11 

8 

13 

12 

11 


81 

11 

12 

11 

10 

, 8 

12 

11 

9 


9 

8 

9 

12 

8 

6 

12 

10 

8 


23 

11 

11 

9 

14 

8 

11 

8 

11 

(V) 

38 

6 

6 

6 

7 

• 6 

11 

6 

6 

Grammar 

43 

4 

2 

7 

6 

4 

8 

6 

6 


61 

8 

11 

11 

12 

8 

l4 

12 

9 


81 

11 

12 

11 

13 

8 

14 

11 

9 


9 

6 

10 

11 

8 

7 

8 

10 

8 

(VI) 

23 

9 

11 

10 

11 

8 

10 

8 

10 

38 

6 

9 

8 

.7 

5 

8 

5 

7 

Vocabulary 

43 

5 

7 

8 

7 

5 

7 

6 

7 


61 

11 

11 

11 

12 

11 

13 

12 

11 


81 

13 

12 

12 

9 

9 • 

14 

11 

12 


9 

6 

9 

9 

8 

6 

10 

10 

9 

(VII) 

23 

8 

10 

8 

10 

6 

10 

8 

12 

38 

5 

6 

5 

5 

2 

g 

5 

4 

Sentence 

43 

2 

4 

5 

5 

4 

7 

5 

4 

Structure 

61 . 

10 

11 

11 

12 

11 

12 

12 

9 


81 ’ 

12 

12 

12 

10 

9 

13 

11 

12 
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Category 


(I) 


Sense 


(H) 

General 

Impression 


(HI) 

Spelling 


(IV) 

Punctuation 


(V) 


Grammar 


(VI) 

Vocabulary 


(ATI). 

Sentence 

Structure 


TABLE n (2) 

Essay-sdbject A1 

Cand. MarlvS awarded to Scripts by Examiners : — 
JTo. P Q K S T B V AA'" 


G 

5 

4 

5 

6 

5 

10 

9 

6^ 

13 

4 

6 

7 

6 

8 

7 • 

7 

2 

52 

9 

6 

8 

8 

7 

8 

7 

6 

69 

8 

9 

11 

6 

4 

11 

8 

Id 

69 

3 

8 

5 

3 

5 

9 

8 

12 

86 

11 

13 

12 

7 

4 

9 

11 

12. 

6 

S 

9 

7 

6 

6 

10 

9 

11 

13 

5 

7 

6 

6 

7 

7 

7 

6 

52 

7 

7 

8 

9 

6 

7 

7 

9 

69 

7 

9 

9 

6 

4 

10 

7 

10 

69 

2 

5 

4 

2 

3 

6 

7 

5^ 

85 

11 

13 

12 

7 

5 

10 

11 

11 

6 

11 

11 

12 

11 

7 

12 

9 

12 

13 

13 

10 

13 

10 

8 

12 

8 

9 

52 

12 

9 

12 

10 

6 

10 

7 

10 

59 

12 

14 

9 

10 

5 

12 

8 

' 11 

69 

6 

4 

7 

2 

3 

5 

6 

6 

85 

12 

14 

13 

11 

8 

11 

11 

12 

6 

9 

11 

12 

8 

7 

9 

9 

11 

13 

4 

5 

6 

5 

7 

5 

8 

7 

62 

7 

8 

7 

11 

3 

7 

7 

9' 

59 

11 

11 

8 

7 

6 

11 

8 

12 

69 

3 

1 

4 

o 

3 

3 

7 

3. 

85 

11 

13 

13 

11 

8 

12 

11 

11 

6 

11 

9 

11 

8 

11 

12 

9 

12 

13 

8 

6 

12 

11 

7 

8 

8 

8. 

62 

7 

7 

8 

10 

6 

7 

7 

9' 

59 

9 

11 

11 

8 

6 

9 

7 

11 

69 

7 

5 

5 

7 

5 

11 

6 

5- 

85 

11 

13 

14 

11 

6 

10 

11 

11 

6 

11 

10 

8 

8 

10 

8 

8 

12. 

13 

7 

8 

12 

8 

7 

7 

8 

S'. 

52 

8 

8 

9 

10 

8 

7 

7 

11 

59 

7 

9 

11 

7 

7 

10 

7 

12. 

69 

4 

8 

7 

o 

5 

4 

S 

9' 

85 

11 

12 

12 

11 

6 

9 

11 

11 

6 

9 

10 

7 

8 

8 

10 

9 

12. 

13 

5 

7 

6 

7 

6 

7 

7 

7 

52 

5 

7 

8 

9 

o 

6 

7 

9 

59 

.7 

9 

8 

8 

5 

11 

7 

9 

69 

o 

6 

4 

2 

5 

5 

8 

6- 

85 

12 

14 

12 

8 

6 

11 

11 

11. 
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THE iEVUTCnsti ‘OF ENGLISH ESSAYS 


TABLE n {3) 


Essay - soBJECT B 


Cand. 

Claries awarded to Scripts by 

Examiners ; 

Catogorj' 

Ko, 

P 

Q 

R 

s 

T 

U 

V 


11 

9 

11 

10 

10 

10 

10 

9 

(I) 

Sense 

22 

43 

45 

7 

4- 

5 

8 

5 

11 

10 

5 

8 

6 

5 

9 

8 

6 

10 

11 

6 

9 

8 

5 ' 
0 

C8 

11 

10 

11 

9 

12 

12 

11 


99 

7 

6 

7 

8 

8 

8 

5 


11 

9 

12 

10 

11 

10 

10 

9 


22 

7 

10 

10 

7 

7 

11 

8 

(H) 

43 

3 

4 

5 

5 

5 

6 

5 

General 

45 

5 

10 

9 

9 

8 

11 

6 

Impression 

68 

99 

11 

5 

12 

6 

11 

7 

9 

7 

11 

5 

12 

7 

11 

5 


11 

14 

14 

13 

14 

11 

13 

9 


22 

13 

12 

13 

12 

7 

12 

8 

(m) 

Spelling 

43 

45 

68 

5 

11 

15 

5 

7 

14 

4 

12 

12 

2 

7 

14 

2 

7 

14 

4 

8 

14 

5 

7 

10 


99 

8 

5 

7 

2 

2 

5 

5 


11 

8 

10 

12 

11 

7 

10 

9 

(IV) 

Pvmctnation 

22 

43 

8 

2 

5 

5 

12 

8 

5 

7 

7 

4 

13 

5 

7 

5 


45 

5 

11 

11 

10 

7 

11 

7 


68 

11 

9 

12 

11 

11 

12 

11 


99 

5 

7 

7 

8 

7 

7 

8 


11 

7 

9 

7 

8 

8 

10 

7 


22 

9 

10 

12 

10 

7 

12 

8 

CV) 

43 

5 

2 

8 

8 

5 

8 

5 

- Grammar 

45 

7 

10 

12 

11 

8 

14 

7 


68 

11 

12 

12 

11 

11 

11 

11 


99 

6 

5 

11 

8 

5 

8 

7 


11 

12 

12 

11 

11 

11 

12 

9 


22 

8 

10 

9 

8 

8 

11 

8 

{VI) 

43 

4 

9 

7 

8 

5 

6 

5 

Vocabulary 

45 

6 

11 

11 

9 

9 

12 

7 

68 

8 

12 

11 

9 

14 

12 

11 


99 

5 

8 

8 

8 

6 

8 

5 


11 

9 

11 

11 

10 

11 

12 

8 


22 

7 

10 

10 

8 

8 

11 

8 

(vh) 

43 

2 

2 

5 

7 

2 

5 

5 

Sentence 

45 

5 

10 

11 

10 

8 

12 

7 

Structure 

68 

7 

12 

11 

9 

11 

11 

11 


99 

6 

7 

7 

7 

5 

7 

7 


i 


W 

13 

6 

2 

5 

12 

8 

13 
7 

4 

7 
12 

5 

14 

8 
2 
7 

14 

4 

13 

7 

8 

7 

12 

6 

11 

8 
8 
8 

12 

6 

14 
8 
7 
9 

12 

7 

11 

7 

7 

7 

10 

5 
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TABLE H (4) 

• , Essay-subject B1 

Cand. Marks awarded to Scripts by Examiners : — 


Categorj’- 

bTo, 

P 

Q 

R 

s 

T 

U 

V 

w 


4 

5 

9 

11 

8 

7 

7 

8 

11 


12 

8 

13 

11 

14 

14 

10 

11 

12 

(I) 

68 

11 

11 

13 

11 

12 

12 

12 

13 

Sense 

80 

7 

8 

8 

8 

5 

7 

7 

7 


93 

5 

8 

6 

7 

5 

5 

7 

4 


98 

2 

6 

6 

5 

7 

2 

8 

7 


4 

6 

11 

11 

9 . 

8 

9 

9 

11 


12 

11 

13 

11 

14 

13 

11 

11 

11 

(H) 

68 

9 

10 

13 

11 

12 

13 

12 

13 

General 

80 

7 

8 

7 

8 

5 

7 

8 

8 

Impression 

93 

6 

8 

6 

7 

4 

5 

7 

5 

98 

6 

11 

6 

6 

7 

5 

8 

. 8 


4 

12 

14 

13 

12 

8 

10 

9 

8 


12 

12 

14 

12 

14 

14 

13 

11 

11 

(in) 

68 

14 

14 

13 

15 

11 

13 

12 

14 

Spelling 

80 

13 

13 

12 


7 

9 

7 

8 

93 

11 

9 

7 

8 

4 

5 


<! 


98 

12 

14 

11 

11 

11 

9 

8 

u 

8 


4 

6 

11 

13 

13 

8 

11 

0 



12 

11 

13 

12 

14 

14 

13 

11 

21 

(IV) 

68 

11 

11 

13 

12 

11 

13 

12 

13 

Punctuation 

80 

7 

10 

11 

11 

7 

8 

8 

7 


93 

8 

8 

6 

8 

5 

8 




98 

7 

11 

11 

11 

7 

12 

/ 

8 

u 

7 

(V) 

Grammar 

4 

12 

68 

80 

7 

8 

8 

8 

11 

13 

10 

8 

13 

12 

13 

11 

14 

13 

11 

7 

8 

14 

11 

7 

11 

11 

14 

9 

11 

12 

11 

8 

13 


93 

6 

8 

11 

8 

4 

O 

7 

8 


98 

6 

11 

8 

7 

7 

O 

11 

7 

8 

4 

8 


4 

7 

12 

11 

11 

o 

10 

11 

13 

8 



(^n) 

Vocabxdary 

12 

68 

80 

93 

9 

8 

6 

6 

14 

11 

8 

8 

11 

13 

8 

8 

13 

10 

8 

8 

c 

Id 

11 

o 

r* 

9 

11 

12 

8 

9 

12 

14 

8 


98 

7 

13 

8 

12 

O 

12 

5 

11 

7 

9 

6 

11 

(TO) 

Sentence 

Structure 

4 

12 

68 

80 

93 

6 

10 

8 

7 

7 

11 

13 

9 

8 

8 

11 

9 

13 

7 

7 

10 

14 

9 

S 

8 

8 

14 

10 

5 

10 

11 

14 

8 

9 

11 

12 

8 

n 

8 

14 


98 

6 

13 

7 

10 

4 

8 

5 

11 

7 

9 

o 



28 


THE MARKING OF ENGLISH ESSAYS 


TABLE II (5) 
Essay-subject C 


Cand- Marks aivordcd to Scripts bv Esaminors : — 
Category No. P Q B S T * U V W 



2 

7 

7 

C 

8 

G 

8 

7 

8 


32 

5 

4 

0 

6 

6 

6 

C 

6 

(I) 

35 

C 

7 

8 

8 

7 

12 

8 

7 

Sense 

41 

11 

12 

11 

9 

10 

11 

9 

11 


93 

5 

8 

7 

7 

5 

9 

8 

5 


95 

11 

11 

9 

8 

11 

13 

11 

13 


2 

7 

7 

5 

8 

7 

9 

7 

8 


32 

6 

5 

4 

8 

5 

7 

6 

7 

(H) 

35 

8 

7 

8 

8 

8 

11 

8 

8 

General 

41 

11 

12 

10 

10 

10 

10 

9 

12 

Impression 

93 

5 

8 

6 

7 

5 

8 

7 

6 


95 

11 

11 

9 

8 

11 

11 

10 

12 


2 

11 

13 

11 

11 

7 

11 

11 

8 


32 

7 

5 

11 

8 

5 

5 

0 

7 

(m) 

35 

12 

13 

13 

13 

8 

11 

14 

9 

Spelling 

41 

13 

14 

13 

14 

11 

13 

14 

11 


93 

7 

9 

11 

8 

5 

9 

7 

6 


95 

14 

13 

13 

12 

12 

12 

14 

12 


2 

7 

8 

11 

8 

7 

12 

9 

8 


32 

7 , 

7 

14 

8 

7 

8 

8 

7 

(W) 

35 

9 

7 

14 

11 

7 

11 

9 

7 

Punctuation 

41 

10 

12 

12 

10 

8 

9 

9 

13 


93 

5 

9 

6 

5 

6 

12 

7 

6 


95 

11 

12 

13 

8 

10 

11 

11 

12 


2 

6 

7 

5 

8 

8 

11 

7 

8 


32 

7 

8 

14 

11 

7 

8 

8 

14 

(V) 

35 

s 

8 

14 

12 

8 

11 

9 

14 

Grammar 

41 

11 

12 

13 

13 

9 

11 

9 

13 


93 

6 

8 

12 

7 

7 

8 

8 

5 


95 

11 

11 

13 

11 

10 

13 

11 

12 


2 

7 

8 

7 

8 

8 

8 

•7 

8 

(VI) 

32 

6 

8 

8 

10 

8 

8 

8 

8 

35 

8 

8 

8 

8 

7 

10 

9 

9 

Vocabxilary 

- 41 

11 

12 

10 

11 

10 

11 

9 

12 


93 

5 

8 

8 

8 

8 

8 

8 

6 


95 

11 

11 

9 

8 

11 

12 

11 

12 


2 

8 

8 

6 

8 

8 

8 

8 

8 

(VE) 

32 

6 

8 

8 

9 

8 

8 

8 

8 

35 

7 

8 

8 

9 

8 

10 

9 

8 

Sentence 

41 

11 

12 

10 

10 

10 

9 

9 

11 

Structure 

93 

5 

8 

6 

7 

7 

7 

8 

7 


95 

10 

11 

9 

8 

10 

12 

11 

13 
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TABLE n (6) 

EsSAy-SDBJEOT Cl 

Cand. Marks a%varded to Scripts by Examineis : — 
Categorj* No. PQB STUVW 



25 

13 

11 

11 

10 

10 

12 

8 

11 


37 

7 

6 

8 

8 

6 

6 

9 

7 

(I) 

66 

6 

8 

7 

7 

6 

8 

8 

• 7 

Sense 

68 

7 

14 

12 

12 

12 

12 

12 

12 


82 

7 

9 

9 

5 

6 

7 

7 

7 


95 

11 

11 

9 

9 

7 

11 

11 

8 


25 

11 

10 

8 

9 

10 

10 

8 

8 


37 

8 

8 

8 

8 

6 

7 

9 

8 

(H) 

66 

8 

7 

7 

7 

6 

9 

8 

8 

General 

68 

8 

14 

11 

12 

12 

12 

12 

12 

Impression 

82 

8 

8 

9 

6 

6 

8 

7 

7 


95 

11 

11 

9 

10 

7 

11 

11 

9 


25 

11 

10 

9 

9 

7 

9 

7 

5 


37 

11 

10 

12 

8 

7 

9 

9 

8 

(HI) 

66 

11 

14 

13 

11 

11 

11 

8 

8 

Spelling 

68 

U 

14 

14 

14 

14 

14 

12 

12 

82 

12 

14 

14 

8 

7 

11 

8 

7 


96 

13 

14 

12 

14 

8 

11 

11 

9 


25 

9 

8 

7 

8 

8 

7 

8 

7 


37 

8 

10 

12 

11 

7 

8 

9 

7 

(IV). 

66 

9 

6 

12 

8 

5 

12 

8 

6 

Punctuation 

68 

8 

14 

13 

13 

14 

13 

12 

12 


82 

8 

9 

12 

8 

7 

11 

8 

8 


95 

10 

11 

12 

11 

8 

9 

11 

10 


25 

11 

11 

12 

12 

9 

12 

8 

8 


37 

9 

10 

12 

11 

8 

8 

9 

8 

(V) 

66 

8 

7 

12 

8 

6 

11 

8 

8 

Grammar 

68 

7 

13 

14 

12 

11 

10 

12 

10 


82 

8 

7 

13 

8 

6 

11 

8' 

8 


95 

11 

11 

11 

12 

8 

11 

11 

8 


25 

11 

10 

9 

8 

9 

11 

8 

9 


37 

8 

8 

8 

8 

6 

8 

9 

8 

(VI) 

66 

7 

8 

8 

8 

8 

8 

8 

8 

Vocabulary 

68 

9 

14 

12 

12 

13 

13 

12 

14 

82 

7 

7 

8 

8 

6 

9 

8 

8 


95 

11 

11 

8 

10 

7 

9 

11 

6 


26 

11 

10 

7 

8 

10 

10 ' 

8 

7 


37 

7 

8 

7 

7 

6 

7 

9 

8 

(VH) 

66 

7 

7 

7 

8 

5 

9 

8 

7 

Sentence 

68 

7 

14 

11 

12 

12 

12 

12 

12 

Structure 

82 

S 

6 

8 

8 

5 

8 

8 

7 

95 

9 

11 

8 

10 

7 

11 

11 

9 
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THE ]\IAHKINO OF ENGLISH ESSAYS 


Measure of Agreement between Examiners 

46. The first question we shall ask of our data is “ What measure 
of agreement exists between examiners on the marking of all the 
essays for all of the seven categories ? ” There are three aspects 
of this agreement, each of wliich wall be considered separately : — 

(i) Do examiners agree as to the general standard of the scripts, 
i.e. does Examiner X always tend to award the same marks to a 
particular script or batch of scripts as Examiner Y, or are his 
marks in general higher (or lower) than those awarded by 
Examiner Y ? 

(ii) How far do examiners agree as to the spread of their marks 1 
It is frequently found, for example, that in examinations of the 
type here considered examiners refuse to use the highest and the 
lowest marks of the scale, thus reducing the effective spread of 
their marks. A measure of the extent to which the total scale 
is used by an examiner is the standard deviation of his marks. ^ 

(iii) How far do examiners assign to scripts the same marks 
and rank them in the same order of excellence when they mark 
them for a second time without knowing what marks they assigned 
to them on the first occasion 1 

Questions (i) and (ii) are considered below ; Question (iii) will 
be considered in the section on Re-marking (see pp. 60-79 below). 

47. Although in conference the examiners had reached some 
general agreement as to the degree of merit denoted by each 
literal mark, it was evident from an inspection of their marks 
that some of the examiners regularly awarded higher marks than 
others. Table HI gives the mean of the marks awarded to each 
essay-subject for each category by each of the examiners. 

TABLE ra - 


Meahs (fob 100 scBrPTs) or Exasiinebs’ Mabks 
(On a scaee 1 TO 16) 


Category 

Essay- 

subject 

P 

Q 

B, 

Examiner 
S T 

XT 

V 

W 

Total 

Mean 


A 

7-97 

8-23 

9-13 

8-10 

6-97 

8-85 

8-26 

8-11 

65-61 

8-21 


A1 

7-25 

8-16 

8-49 

6-29 

6-98 

7-57 

7-63 

8-48 

60-84 

7-69 


B 

7- 14 

8-98 

8-59 

8-19 

8-69 

8-88 

8-12 

8-55 

67-14 

8-30 

cense 

B1 

7-65 

9-13 

9-02 

8-95 

8-22 

8-86 

8-52 

8-48 

68-83 

8-63 


C 

7-93 

9-62 

8-02 

8-81 

8-38 

9-71 

8-46 

8-90 

69-83 

8-76 


Cl 

8-26 

9-03 

8-63 

8-70 

8-08 

9-28 

8-37 

9-10 

70-05 

8-70 


In statistical terms, we have to compare the means (or averages) and the 
standard deviations (or spreads) of the marks awarded by the examiners and to 
calculate the correlation coe^fficients (or correspondences) between the marks of the 
examiners, considered in pairs. 
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TABEE III — conlitiricd 


Cntcgorj" Essay- Examiner 



aubject 

P 

Q 

R 

S 

T 

U 

V 

W 

Total 

Mean 


A 

7-72 

8-38 

8-24 

8-02 

0-05 

8-02 

8-10 

8-OC 

1 04-03 

8-00 

(H) 

A1 

7-32 

S-CO 

8-27 

C-CO 

0-70 

7-99 

7-01 

8-72 

: 01-87 

7-73 

B 

7-Ot 

9-15 

8-22 

8-02 

7-98 

9-11 

8-09 

8-29 

1 05-90 

8-24 

General 

B1 

7-77 

9-20 

8-16 

8-93 

7-07 

9-29 

8-43 

8-40 

07-90 

8-49 

Impression 

C 

7-80 

9-47 

7-70 

8-75 

S-14 

9-60 

8-24 

8-64 

08-20 

* 8-63 


Cl 

8-27 

9-. 57 

8-10 

8-45 

7-83 

9-39 

8-48 

8-01 

08-70 

8-00 


A 

10-98 

11-30 

10-62 

10-24 

0-93 

10-43 

10-20 

7-88 

78-48 

9-81 


A1 

11-74 

11-60 

10-73 

10-23 

7-45 

10-01 

8-30 

10-05 

80-07 

10-01 

(ni) 

B 

11-48 

10-92 

10-05 

9-49 

7-40 

9-97 

8-20 

8-79 

77-02 

9-03 

Spelling 

B1 

12-05 

11-87 

10-44 

10-74 

7-02 

10-58 

8-60 

8-08 

80-48 

10-00 


C 

10-76 

11-07 

11-48 

10-48 

8-33 

10-40 

10-49 

8-62 

82-12 

10-27 


Cl 

11-20 

11-23 

11-37 

10-19 

8-09 

10-48 

8-69 

8-46 

79-00 

9-95 


A 

7-81 

8-60 

10-13 

9-20 

0-94 

9-04 

8-53 

7-46 

08-57 

8-67 


A1 

7-81 

9-11 

9-33 

8-84 

7-23 

8-20 

8-28 

9-18 

07-98 

8-60 

(IV) 

B 

7-10 

9-20 

9-01 

8-72 

7-79 

9-13 

8-22 

8-29 

08-12 

8-62 

Punctuation B1 

7-35 

9-35 

9-55 

8- 09 

7-54 

9-41 

8-69 

7-97 

08-75 

8-59 


C 

7-65 

9-41 

10-03 

8-05 

8-20 

10-22 

8-83 

8-10 

71-95 

8-99 


Cl 

7-82 

9-12 

9-85 

8-03 

8-25 

9-09 

8-86 

7-83 

70-04 

8-70 


A 

7-89 

8-69 

10-63 

10-11 

G-Pl 

10-29 

8-23 

7-80 

70-36 

8-79 


A1 

8-05 

8-05 

10-14 

10-17 

7-28 

9-58 

8-23 

9-83 

71-93 

8-09 

(V) 

B 

7-63 

9-02 

9-79 

9-07 

7-86 

10-50 

8-18 

8-82 

71-30 

8-92 

Srnmmnr 

B1 

8-10 

9-30 

10-31 

10-45 

7-82 

10-81 

8-64 

8-67 

73-90 

9-26 


C 

7-95 

9-64 

11-00 

10-23 

8-19 

10-28 

8-69 

10-32 

70-10 

9-62 


Cl 

8-09 

10-02 

11-36 

9-99 

8-01 

10-03 

8-83 

8-79 

70-91 

9-01 


A 

7-94 

9-05 

9-03 

8-60 

7-21 

9-10 

8-31 

8-02 

07-82 

8-48 


A1 

8-29 

9-05 

9-28 

8-80 

7-43 

9-07 

8-13 

9-81 

09-80 

8-73 

{VI) 

B 

7-45 

9-67 

9-25 

8-09 

8-49 

0-51 

8-22 

9-49 

70-07 

8-83 

f'ocnbulary 

B1 

7-81 

9-82 

9-28 

8-93 

8-19 

9-84 

8-60 

9-34 

71-77 

8-97 

C 

8-05 

9-70 

8-40 

9-07 

8-90 

9-91 

8-91 

9-32 

72-38 

9-05 


Cl 

8-12 

9-77 

8-82 

8-78 

8-69 

9-81 

8-90 

9-10 

71-96 

8-09 


A 

7-23 

8-25 

8-10 

8-19 

0-70 

8-08 

8-33 

8-02 

03-80 

7-98 


A1 

7-04 

, 8-62 

8-31 

8-31 

0-78 

8-73 

8-21 

8-70 

04-00 

8-08 

(vn) 

B 

0-42 

8-95 

8-24 

7-88 

7-88 

9-24 

8-34 

7-94 

04-89 

8-11 

icntcnco 

B1 

7-10 

9-00 

8-11 

8-26 

7-37 

9-03 

8-00 

8-34 

00-40 

8-30 

Structure 

C 

7-48 

9-28 

7-95 

8-09 

8-22 

9-03 

8-82 

8-49 ^ 

08-60 

8-67 


Cl 

7-83 

9-30 

8-13 

8-30 

8-10 

9-37 

8-97 

8-04 1 

08-70 

8-00 

Sxnminor 


P 

Q 

R 

S 

T 

U 

V 

W 



Cotnl 

344- 73 390-91 391-10 376- 68 324-70 400- 84 360- 97 303-60 



Jean 


8-21 

9-45 

9-31 

8-94 

7-73 

9-54 

8-60 

8-05 




In general. Examiner U gives marks having a high mean and 
Examiner T gives marks having a low mean for all categories and 
essay-subjects. This tendency for examiners to maintain then- 
relative standards of marldng persists throughout the whole 
investigation and manifests itself in Table III as a positive 
correlation between any two rows of the Table. Examiners give 
higher marks for Spelling than for other categories. 


:i2 


Tin: MAUKiNO or rnr.UKH i-^m'^iavk 


48. In ino'it cu'u^h, for nny c'ai<\"ory, the iiic.'in <if the nuirkit 
^civcii for each diri'ctod (''‘'ay not rlilTcr ^i';tn^lc.■vnt!y from 
t!ie incnn of the niarloi aunnlftl for the eorn-aponding undirected 
cPS'ny. Further, tlien* i;f no jdgtufic.'int. difTerence hotuc^n the 
mean of the imirkH luvnrdcd to nny c-A'it\y, for fjen.no fl) nnd the 
mean of the innrhs for (teneral Iinpn!‘"iion (II). 

■19. Tfthlc IV hchnv givoa the Kfnndnrd deviation of each 
cxaiTiinor'8 mark.a for each category in respect of each emy- 
subject. 

TAUI.r. IV 


STAVtiMit) Or.viATto;.* !«!> 'tciunri) or K’CAUtr.’na.’*' .Mauki 

{O.v A ^CA^J: 1 TO ir>) 


Cntfgorj- Ivi'iiiy- 
nubjrct- 


U 


K*nfn!n'’r 

.S T 


< 1 ) 


A 

At 

n 

B1 

c 

Cl 


t; \V Totfll 

2-ell 2-23r. 2-0:t'.t 2-2s7 2-271 2-000 I-MW 2-77fi I7-“Ba 2-223 
-•GOO 2‘C87 2-008 2-2.*r> 1-022 ^*183 10-710 




A 

1-980 

1-782 : 

2-286 

2-270 

2-03S 

1-79S 

1-830 

2-41" 


A1 

2-420 : 

2-004 

2-293 

2-303 

2-243 

2-012 

1-805 

2-070 

(H) 

n 

2-238 

1-977 

2-101 

2-0 M 

2-289 

1-002 

1-80.8 

2-C30 

<!encrnl 

lU 

2-293 

2-109 

2-174 

2-3H9 

2-490 

2-000 

1-700 

'’-■172 

Inipn;.<«^ion 

C 

1-701 

2-090 

2-329 

2-007 

2-145 

1-039 

1-919 

2-389 

Cl 

1-7SS 

1-991 

20(S 

2-027 

2-125 

1-714 

1-857 

2-110 


A 

1-990 

2-583 

2-331 

3-020 

1-831 

2-099 

2-782 

2-224 


A1 

2-120 

2-748 

2-236 

2-925 

1-802 

2-r.3C 

1-12.6 

2-431 

(HI) 

B 

2-052 

2-629 

2-071 

3-048 

2-119 

2-391 

1-585 

2-043 

Spelling 

111 

1-774 

2-288 

2-406 

3-051 

2-024 

2-010 

1-052 

2-409 

C 

2-002 

2-728 

2-234 

2-769 

2-522 

2-040 

3-206 

2-404 


Cl 

2-109 

3- 023 

2-110 

3-029 

2-530 

1-000 

1-032 

2-504 


A 

1-083 

1-774 

2-318 

2-319 

1-COO 

1-002 

1-723 

1-884 


A1 

2-357 

2-300 

2-775 

2-792 

2-130 

2-015 

1-637 

2-487 

(IV) 

B 

2-022 

2-120 

2-2.68 

2-108 

1-951 

2-025 

1-006 

2-334 

Punctuation 

B1 

I- 982 

2-200 

2-598 

2-702 

2-128 

2-160 

1-044 

2-209 


C 

1-093 

2-093 

2-715 

2-295 

2-100 

1-798 

1-732 

2-200 


Cl 

1-840 

2-338 

2-459 

2-105 

2-070 

1-901 

1-410 

2-254 


A 

1-704 

1-934 

2-100 

2-209 

1-727 

2-020 

1-880 

2-332 


A1 

2-338 

2-071 

2-514 

2-458 

1-721 

2-420 

1-502 

2-289 

B 

1-857 

2-19.7 

2-487 

2-030 

1-757 

1-921 

1-705 

2-296 

Grammar 

B1 

1-910 

2-278 

2-235 

2-678 

2-051 

1-017 

1-705 

2-070 


C 

1-.590 

2-012 

2-684 

2-310 

2-300 

1-738 

1-887 

3-169 


Cl 

1-705 

2-010 

1-807 

2-007 

2-467 

1-065 

1-379 

1-950 


A 

1-984 

1-520 

1-921 

1-330 

1-883 

2-019 

1-837 

2-034 

(VI) 

A1 

2-094 

1-571 

1-855 

1-881 

1-603 

2-273 

1-573 

1-932 

B 

2-106 

1-818 

1-819 

1-748 

1-942 

2-017 

1-809 

2-124 

Vocabulary 

B1 

1-983 

; 1-717 

1-709 

1-914 

1-901 

2-019 

1-734 

2-237 


C 

1-878 

: 1-712 

1-830 

1-003 

2-284 

1-484 

1-638 

2-209 


15- 329 
18-999 
17-1-43 
17-793 
10-992 
10-983 

10-008 

17-319 

16- 247 
10-460 

17- 049 

15- 100 

14-634 

14- 842 

16- 442 

15- 214 
14-098 


1- 910 

2- 375 
2-143 
2-224 
2-124 
2-123 

2-001 

2-165 

2-031 

2-068 

2-208 

1-888 

1-817 

1-856 

1-930 

1-902 

1-837 
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TARLE IV— con/inucd! 


Catcgorj- Eiysay- Examiner 

"r» r» c» r« 



subject P Q 

n 

S 

T 

U 

V 

tv 

Total 

Mean 


A 

2-009 1-097 

2- 185 

1-347 

2-133 

1-913 

1-839 

2-379 

15-802 

1-975 


A1 

2-129 2-OSG 

2-301 

2-013 

2-157 

2-584 

1-519 

2-610 

17-705 

2*221 

(Vll) 

B 

2-359 2-105 

2-030 

1-512 

2-200 

2-001 

1-702 

2-630 

10-665 

2-083 

Sentenco 

B1 

1-930 2-203 

1-969 

1-940 

2-314 

1-95S 

1-631 

2-507 

16-624 

2-000 

Structuro 

C 

1-703 1-SS2 

2-OGG 

1-719 

2-431 

1-0S3 

1-577 

2-189 

16-310 

1-914 


Cl 

1-025 2-032 

1-853 

1-572 

2-075 

1-890 

1-292 

2-070 

15-021 

1-878 

Examiner 


P Q 

R 

S 

T 

U 

V 

W 



Total 


85-89990-101 91-89593-011 92-7-45 85-143'; 

r4-077 

101-084 



Moan 


2-045 2-145 

2-188 

2-215 

2-208 

2-027 

1-704 

2-407 




Examinatiori of Table IV shows that examiners differ in the 
spread of their marks, and that examiners who give a. ndde range 
of marks for one category tend to do so for all categories. The 
standard deviations of marlcs awarded in respect of categor}' I 
for directed essa 3'8 arc, in general, slightly higher than those for 
undirected essa 5 ’s. 

50. It was expected that the eight examiners would agree in 
the marks awarded to directed essaj^s for Sense and General 
Impression more closely than in those awarded to the undirected 
essays. But, as will be shoim, this proved not to bo the case, 

51. It is to be pointed out that the “ raw scores,” i.e. the marks 
actually awarded by the examiners, do not yield immediately 
the necessary data for ascertaining the degree of their agreement 
as to the relative merits of individual scripts. In order to 
ascertain this we have to eliminate the differences of idiosyncrasy 
of the examiners in regard to two points which do not depend 
on the inherent differences between candidates 

(i) the differences generally described as differences of 
" standard ” or “ leniency ” measimed by differences beriveen the 
mean marks awarded by examiners to the whole number of 

scripts *, and , j . . i 

(ii) the difference of “ spread ” of the marlcs as measured by the 
" standard deviations ” (see para. 40, footnote 2, and para. 46 


consider these two points separately. If we ^d that 
the mean marks of one Examiner, X, are 10 per cent, lugher than 
those of another, Y, we can render the comparison of the judg- 
ments of individual scripts fairer by raising the marks of Y by 
10 per cent, for each script. This process wffl leave the order of 
the scripts unchanged, though it will alter the absolute value 
of the marks assigned to them by Y.’^ 

» It is to be noted tliat tliis correction is based on tbo hypothesis that Exammera 
X and Y aro steady in their ostunates and does not allow for random variations. 


— P.J.H. 


c 
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Wc now consider tlic second point. Jx:t ns suppose that the 
means of the marks awarded by Examiner X and Examiner Y 
are the same, but that the ranges of their marks arc different. 
Thus, for instance, taking our fifteen-point scale, .suppose tliat 
the mean mark of both Examiners X and Y is C, but that 
while the marks of X range from E to A-j-, those of Y range 
only from D— to B-l-, we may then .say that while there is no 
difference in “ standard ’’ or n%'eragc “ leniency ” between the 
two examiners, there is a marked difference in the “ spread ” of 
their marks, which makes it impossible to comp.are their judg- 
ments in regard to any particular script without allowing for this 
difference of spread. 

52. The method of converting " raw' scores " into " standard 
scores ” takes account of both the points that wo have considered, 
the differences in mean marks (or leniency), and the differences 
in the spread of marks of the two examiners. The “ raw scores ” 
of the examiners are converted into “ standard scores ” by means 
of a simple formula.* 

Table V gives for the first two categories of essay A the 
“ standard scores ” of the marks given in Table II (1), 


TABLE V 

Sajipie Stakdaiid Scores fob Cateookv I (Sekse) aitd Catecoby II (GEKiaiAi 
Impbessiok) roB Essay-svbject A ____ 


Category Cand. Standard Score of Examiner 

1^0- B Q R S T tJ V W 


9 

(I) 23 

Sense 38 

43 
61 
81 


-0-44 —2-78 
-fOOl +0-79 
—0-44 -i-0-34 
— 1-80 —1-89 
-fl-82 +1-24 
-fl-37 -^l•68 


+0-88 —1-11 
-i-0-88 -fO-68 
—0-99 —0-39 
-1-46 —1-47 
-i-1-34 +1-75 
-fl-81 -0-39 


—0-43 -fl-02 
-0-43 —0-40 
— 1-74 -}-0 07 
— 1-74 — 1-3G 
+ 1-77 +i-eo 
-fl-33 -i-1-50 


-i-0-95 —M2 
—0-14 -t-1-40 
—1-24 —0-40 
—2-33 —2-20 
-i-2-05 -fl-40 
-fO-93 -Fl-76 


—0-30 
-0-30 
-1-70 
— 1-70 


-(-M6 

-f004 

-1-0-04 

-1-62 


-t-1-03 
—0-05 
— 1-68 
- 2-22 


0-00 
+ 1-24 
-1-24 
—2-48 


9 

(D) 23 

General 38 

Impression 43 
61 
81 


—0-37 —0-77 
-i-0-65 -}-0-91 
—0-88 —0-77 
—2-92 — 3-02 
-fl-16 -fl-47 
-f2-18 -}-2-03 


-fO-77 —1-31 
— 011 + 0-86 

— 1-42 —0-88 

— 1-42 —2-62 
-}-l-21 -fl-73 
•f 1-65 —0-01 


-f2-02 -f-1-71 
-f 1-56 -1-1-71 


-f2-ll -fl-24 
-H-03 -fl-66 


It will be noted that some of the scores are'positive and others 
negative, indicating that some are above the average and others 
below. It wffl also be noted that the standard score, positive 
or negative, is seldom as great as 3-00. 


V scores ” from a set of marks, we first subtract the mean 

then divide the results by the 

Btandard deviation. The formula is : 


where x is the original mark or " 
deviation of the set of marks, and 


X — X 
t7 

raw score ”, x is the mean, 
z is the “ standard score.” 


<r is the standard 
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S3. The next question to be considered is this : Do examiners 
apreo more cIoscl 5 ' in the marks tlicy give to c.ssaya for llio 
category " Sense ’’ u’hicli is capable of an agreed definition, than 
they do for the rather ill-defined categor}' “General Impression.” 

5 }. In orrlcr to supply tho niwwer to this question, the standard 
.srore.s were further examined. Tho eight .standard score.s awarded 
to a script for one category were plotted graphically ns a cnmitlativc 
frequrnetj r.urrc having “standard score.s” ns absciss®, and tho 
number of examiners who awanlcd a certain mark or less as 
ordinates. Tho procedure may be explained by the following 
example : tho standard marks awarded by the eight examiners to 
script 34, essay-subject C, categor 3 ' “ General Impression ” were 

P Q H S T U V \V 

-0-U -0-22 -fOOl -O-SS 4-0-7C +0-28 -iO-43 -fO-10 

When these are arranged in order of magnitude we have : — 
-0-8S -0-22 -O-ll -fO-01 -1-0-lD -{-0-28 -fO-13 -fO-76 

This ma_v bo interpreted ns meaning that 

ono oxnminor gi\va a mark — 0-88 

two examiners gi\t> „ „ —0-22 or less 

three examiners gt\-e „ „ — 0*11 or less, etc. 

Hence, plotting standard scores as absciss® and tho number 
of examiners who give a mark ns low ns y ns ordinates, we obtain 
the cumulative frequenej* curve shown in Figure I. 

FIGURE I 



KC«tt 
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FIGURE 2 



FIGURE 3 



S7WOAM> scout 


STATISTICAL EEPORT 


37 


55. The curve here depicted is in the form of an S. This is 
the typical form for the cumulative frequency curve (ogive 
curve) derived from the normal frequency distribution (see 
para. 56 below). 

It win be observed that one examiner rates the script 0-88 
units below his average, and another 0*76 units above his average, 
while the other examiners give intermediate marks. If the 
examiners’ marks had agreed more closely, the curve would have 
sloped more steeply ; see Figure II. For a script for which there 
is less agreement, the curve will be more flat ; sec Figure III. 
Any measure of the steepness of the cmwe is therefore a measure 
of the agreement between the examiners. This is a better method 
of measming the agreement between the examiners than 
measuring the total range of marks, because the range only takes 
into accoimt two marks, the highest and the lowest. The 
difference between these two marks (the total range) is a measure 
of the extreme disagreement between examiners but is not a 
good measmre of agreement, since the marks of one examiner 
may be outstanding while the others are in close agreement. 

One measure of steepness is the interquartile range* which 
can be read directly from the graph. 

56. The chief advantage of the graphical method, which is 
extremely laborious, is that individual abnormalities which do 
not show themselves in the usual statistical techniques are 
strikingly apparent in the graph. Because of the great amount 
of work involved, only two categories (Sense and General Im- 
pression) were considered. This involved the drawing of 1200 
cumulative frequency curves (for 6 essay-subjects, 2 categories, 
100 candidates) and the measurement of 1200 interquartile 
ranges. The great majority of the cmwes (96 per cent.) were 
found to be continuous and of approximately the same form as 
the ogive curve of the normal frequency distribution ; see 
Figure I. This suggests to the statistician that in the majority 
of cases the differences between the awards of the eight examiners 
are due to the operation of a relatively large number of minor 
factors rather than to a small number of factors of great 
importance. - 

About 4 per cent, of the cmrves Avere discontinuous and a 

* The interquartile range is the number of rmits measured along the base-linf, 
of the graph, between the point a and the point 6, where a is that point belovr 
which one-quarter of the standard scores lie, and b is that point b61ow which 
thr^-quarters of the standard scores he. 

’ Normal distributions result when variations are due to a very largo num}>er 
of minor factors (see G. U. Yule, Introduction to the Theory of Statislxcs, GriUit), 
1932, Oil. 16, para. 13, p. 306). 
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further examination of such cnscH ahoAvcd that it was possible 
for examiners to liolcl witlclj' different views on the excellence 
of the essay in question. For oxnmplo : one candidate in a letter 
on the subject of Speech Da}' Proceedings, chose to adopt a 
facetious stylo and to use schoolboy slang. One group of 
examiners penalised the candidate heamly, regarding this inter- 
pretation of the subject ns unsuitable, while others rated him 
fairly high because, in their opinion, ho had fulfilled the require- 
ments of the question. Figure IV illustrates quite distinctly 
this division of opinion among the examiners. 

r 

FIGURE A 



57. The cumulative frequency curves show, for different 
scripts, a wide range in the degree of agreenient between the 
various examiners. The closest agreement was for candidate 70, 
essay-subject Cl, category 11 (General Impression), where the 
mterquartile range was only O'lO units ; and the greatest dis- 
a^eement occurred for candidate 77, essay-subject C, category I 
(bense), where the interquartile range was 2-10. The following 

able gives the mean values of the interquartile ranges for each 
essay : — ^ ° 


A 

B 

Essay-subject 

C A1 

B1 

Cl 

•83 

•75 

•73 

•84 

•75 

•78 

•87 

•78 

•73 

•95 

•78 

•84 


General Impression 
Sense 
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Grouping the directed and undirected essay-subjects together, 
•we have the folio-wing means ; — 


General Impression 
Sense 


A, B, and C 
•770 
•793 


Al, Bl, and Cl 
•790 
•867 


All Essay-subjeota 
•780 
•826 


The only significant difference is that for Sense beWeen essay- 
subject 0 and essay-subject Al . The comparatively high fig^e for 
Sense for essay -subject Al suggests that, from the examiners point 
of "vie'W, this subject ■was less suitable than the others. There is 
no significant difference between the average interquartile range 
of the examiners’ marks for directed and that for undirected 
essays. Further, the somewhat unexpected result appears that 
the examiners do not show greater agreement when marking 
for a well-defined category such as Sense than they do when 
marlcing simply for General Impression. 

58. If for the purpose of comparison we define “ close agree- 
ment ” of the examiners as corresponding to an interquartile range 
of less than 0-4, and “ -wide disagreement ” as corresponding to an 
interquartile range of greater than 1 -0, we find that in no instance 
were all the examiners either in close agreement or in -wide 
disagreement in judging the six essays of a single candidate. 
There was a slight but noticeable tendency for examiners to agree 
more closely both when marking scripts for which they awarded 
very high marks and when marking scripts for which they awarded 
very low marks. This effect is a very familiar one to examiners 
and has been explained by the fact that for good scripts the range 
of possible marks is restricted at the upper end by the maximum 
mark and for poor scripts the range is similarly limited by the 

zero mark. , • 

Analysis of Vaeiance^ 

69 Measurements of any human character differ from one 
indi-ddual to another. We may express these measimements as 
de-yiates from their mean and call the de-viates variations. If 
we consider the variations of such a character as human stature, 
we shaU find in general that they do not form a s^ctly homo- 
geneous group. For example, two species may differ m their 
mean stature while there are wide variations from the mean 
within each species. Even within a single species it is always 
possible to find regional differences and genetic differences. 
Indeed we can only be reasonably certam that variations form 
’ a homogeneous distribution when they are pimely random, i.e. 
when they are caused by a large number of mmor factors which 

1 For a Koto on Analj-sis of Variance and Factor Analysis, see p. 149 below. 
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cannot be distinguished. Because it is so difficult in a research 
to plan an experiment yielding data having strictly homogeneous 
variation, it is customary to attempt to control the conditions 
of an experiment in various ways so that it may be possible to 
compare the variations of the data imder different conditions. 
As a measure of the total variation of the data, we use the 
variance of the data, which is defined as the sum of the squares 
of the deviations of a series of values from their mean, divided 
by the corresponding number of “ degrees of freedom.”^ In 
other words, the variance is the square of the standard deviation. 

60. The 800 General Impression marks awarded to one essay- 
subject by our eight examiners constitute a group of measure- 
ments which may not be strictly homogeneous. It would seem 
to be of value to be able to differentiate the variation in this 
group of marks according to the various causes of its departures 
from homogeneity. Professor R. A. Pisher and his school have 
developed a method for analysing variance into its component 
causes.* We shall apply the analysis of variance technique to 
our data. 


61. An inspection of the eight marks awarded by the eight 
examiners to any one script for any category reveals differences 
between the marks. In no instance have aU the examiners 
awarded the same mark to a script (except in the case of marks 
for Literacy, where only a three-point scale was used). The 
differences are not solely due to differences in leniency of marking 
of the examiners, for if this were so, a simple adjustment of 
marks by addition or subtraction would equalise the marks. 
Por, as we have previously suggested, if Examiner X marked 
consistently 10 per cent, higher than Examiner Y, then the 
differences between the marks of Examiner X and Examiner Y 
awarded to the same scripts could be removed by the addition 
of 10 per cent, to the marks awarded by Examiner Y. With our 
data, large differences still remain when this adjustment has been 
made. As may be seen from Table V, adjustment of marks 


- utilizer of degrees of freedom (a phrase borrowed from mechanics) is 

.y subtracting from the number of measurements used the number of 
constmmtB or mdependent linear relations obtaining between them. Thus if N 
?o measured from the same mean the number of degrees of freedom 

^ ~ l^deviates are known the remaining one can be 
be shown alg^raic sim of the deviates from the mean being zero. It can 

number of degrees of freedom, rather than the 
a^vaHsnn^t preferred in the estimation of standard deviations 

( w IS a large number of deviates, N is nearly equal to 

' » It wsTorfl-^® u^*®^ j ^ divisor for convenience of calculation, 
in othe^brnn^w ^7 cppbed to agncultural data but has since been employed 


■ ) 
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both for differing leniencies of examiners and for different spreads 
of marks still leaves obvious differences between the eight marlis 
awarded to one script. The questions we attempt to answer here 
are : How great are the differences due to tmavoidable chance ? 
How great are the differences due to real differences of judgment 
between the examiners ? 

62. H each one of a very large number of competent examiners, 
marking under the same conditions, awards a mark to the same 
script, then we shall not in general have complete agreement 
between the examiners. Practical experience leads us to assume 
that we may expect to find that there will be one most firequent 
mark which we shall call H, the remahiing marks being distributed 
above and below H, the average mark, in accordance with the 
normal curve. Any single examiner’s mark will usually differ 
from H for two reasons : (i) because the exa min er will differ from 
his fellows in his estimate of the value of the script ; and (ii) 
because there will be imavoidable random (or chance) errors of 
marking. The mark H m&j be taken as an ideal measure of the 
“ absolute merit ” of the script.^ 

63. If it could be arranged that any one examiner should mark 
the same script many times, then, assuming that he neither 
remembers his previous mark nor is rendered careless through 
boredom, we may expect that more frequently than any other 
mark he will award a mark, say, Q, but sometimes will, award a 
higher mark, and sometimes a lower mark. His marks will be 
normally distributed about Q as an average. We may consider 
0 to be the ideal measure of that particular examiner’s estimate 
of the merit of the script. 

In general this will differ from the “ absolute merit ” of the 
script, and we may take the difference between the examiner’s 
ideal mark Q and the absolute merit H for the same script to 
be a measure of the examiner’s idiosyncrasy G. Thus* 

0 - E =^G ... (i) 


1 The statistical methods used in this Report may perhaps ho compared rvith 
those used by Dr. Rhodes and Professor Burt in tlie earlier investigations carried 
out under the auspices of the International i^tituto Examinations Enquiry and 
recorded in The iVfarf-s of Examiners (Macmillan & Co., 1936). 

In the present Report tlueo distinct methods of approadi have been used ; 
(o) the study of mean and standard deviations, vliich is similar to that used by 
Dr. Rhodes. The graphical analysis \ised in the study of marks for Sense and 
General Impression carries the study one step further : (6) the study of variance, 
irliicli tras suggested by Dr. Rhodes in Chapter XII of The Maris of Examiners ; 
and (c) the method of factor-analj.sis, which was suggested by Professor Burt 
in his Memorandum on the Analysis of Examination Marks, in the book referred 
to above. — C.E.S. . j-™. 

=‘In tills, and the equations which follow m this section, algebraic differences 
are to bo understood. 
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64. When an examiner marks a script only once, his mark may, 
and indeed in most cases "vviU, differ from Liis ideal mark for the 
script, being either greater or less than it by an amount E, which 
is called the random, or chance, error. If X is the mark awarded 
for one category by one examiner to a particular script, then 

X - G = E - (ii) 

Therefore X - (G + E) = E 

Or X =E +C +E ... (iii) 

An examiner’s mark may thus be considered to he made up of 
three parts : E, the absolute merit of the script ; C, the idiosyn- 
crasy of the examiner, and E, the random error. 

65. In what precedes we have been considering the marks 
awarded to one particular script, but have not considered whether 
this script is a good one or a bad one. For some scripts the 
absolute merit E will be high, for others it will be low. If th® 
average value of E for all scripts on the same essay -subject is 
represented bv A, then 

E - A = B ... (iv) 

where B is the amoimt by which the absolute merit E of the 
script is above or below the average A. 

Therefore X=A+B-\-0-\-E ••• (■^) 

Thus the mark X received by a candidate for his script is here 
defined in terms of four constituents : (1) the general average 
A ; (2) the candidate’s deviation B from this general average ; 
(3) the idiosyncrasy C of the examiner (4) the.random error E 
incidental to the marking. 

If X^f is the mark given by a particular examiner s to a given 
script (or candidate) t, the above equation may be written more 
fully as ; 

X,t=A +B,+G,+E„ - (vi) 

66. It is the aun of the examiners and examining boards to 
make C and E as small as possible, so that the final mark may 
be a trustworthy index of the real merit of the candidate’s essay. 
To this end certain precautions are usually taken. The examiners 
meet to discuss the scale to be used in marking the essays, the 
categories for which marks are to be awarded, the standard 
expected at each “ point ” on the scale, and the possible idiosyn- 
crasies of the examiners. A number of essays are then marked as 
trial-scripts, the results are fully discussed and the scheme of 
marking is modified, if necessary. In the present investigation a 
fafteen-point scale was used, since experience has shown that much 
toer scales are too fine for reliable judgment and coarser scales 
do not sufficiently differentiate the candidates. The precautions 



44 


THE MAEKING OF EHGEISH ESSAYS 


\/ ^‘b + 


or O',® = 


B > 


5 ® + 0-0 


... (vii) 

where < 7 ^® is the variance of the “absolute merit marks H , 
is the variance of examiners due to their idiosj^cras > 
and is the variance of the random errors incid^ a 
marking. If is smaU compared 

X may be taken as a fair estimate of the candidate s rea a ^ 
K (o-(,= + cr^®) is comparable to oa^, or exceeds it, the mar g 
may he considered to he imsatisfactory, since the mark 
to the candidate is then determined by the idiosyncrasi^ o 
examiners and by chance factors rather than by the ah y 
the candidate to write an essay. ^Vpn 

70. Let us imagine that we have tabulated the marks gi 
by each examiner to each script on a single category of an essay 
subject, thus : — 


Candidates 

1 

2 

3 

4 

5 


Q 


TABLE VI 
Exanainers 
B S T 


U 


V W' Total 


100 

Total 


Sum 


We wish to calculate (1) the variance between examiners, (2) 
variance between candidates, and (3) the variance due to rando 
error. 

71^Let X he the mean of all the 800 marks in Table 
I^et X„, be the mean of the marks awarded to any candidate w, 
i.e. the mean of the marks in one row of the table. 
be the mean of the marks awarded by any examiner n, i-e- ^ ® 
mean of the marks in any one column of the table. 

72. In order to calculate the total variance of the whole tah^ 
we find the sum of the squares of the 800 deviations from A. 
This may be ^vritten : — 


fiOO 

2: (A% - A)® 


1 


... (viii) 



STATISTIOAI. EEPOBT 


45 


where X,. represents in turn each value in Table VI and H means 

1 

the sum of 800 such terms. 

73. The sum of the squares of the deviates behoeen examiners 
is calculated as follows : If we sum the marks in each column 
of Table VT, we shall have eight totals which are independent 
of the relative merits of the candidates and which differ only 
because examiners differ and because of random errors. We 
may divide each of these totals by 100 and thus derive the mean 
mark for that column. The difference between ~X„ and X 
represents an amoimt of variation (part of the total variation) 
wliich is independent of the candidates. But the deviation due 
to Examiner P is present in each of Examiner P’s marks, that is, 
it occurs 100 times, so that the amount of the total variation 
due to the examiner and due to error but not due to the candidates 
in column P is 100 (X^, — X).* Similar values may be derived 
for each of the eight columns. We may, therefore, write for the 
total variation independent of the candidates in the whole Table : 

100 i: (X„ -X) 

1 

or for the total “ sum of squares ” between examiners 

10oJi(X„-X)‘ ... (ix) 


74. To find the “ sxim of squares ” between candidates we 
must repeat this process with the means of rows. If each row 
in Table VI be summed and the means calculated, we have a 
series of values which are independent of the examiners and 
differ only because candidates differ and because of random 
errors. Let the mean value of row 1 be Xi, then ~ X) 
represents the amount of variation (part of the total variation) 
which is independent of the examiners. This deviation, due to 
the ability of candidate 1 (and to random error) is present in 
each of his marks. Therefore it occurs eight times in the row 
and we may write the total deviation independent of examiners 
for the row as 8 (Xi — X). Similar values may be obtained 
for each of the 100 rows, so that for the whole table we may 
write : — 


' is defined as the average mark of column P. 
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Total variation independent of the examiners 

100 

= 8i7 {X„-X) 


or the total “ sum of squares ” between candidates 

= 8S{X„-xy - W 

1 

75. If we divide the total “ sum of squares ” of equation 

(viii) by the number of degrees of freedom, 799, we have an 

estimate ofaj.* (see para. 59 above). We call this V. In lih® 
manner it may be shown that the quotient V i, obtained by 

dividing the “ sum of squares ” in equation (ix) by 7, is an 

estimate of 

100 + 0-^2 — 

And, dividing the “ sum of squares ” of equation (x) by 99 wo 
obtain Fj, an estimate of lOOcr^® + 

It may also be shown that by subtracting the “ sum of squares 
between examiners plus the “ sum of squares ” between candi- 
dates from the total sum of squares, we have as remainder an 
estimate of the “ sum of squares ” of the random error. The 
“ sum of squares ” of the random error divided by the appropriate 
number of degrees of freedom, 693, i.e. (799—7—99), is an estimate 
of Fj. 

76. Part of our object in the analysis of variance is to compare 
the estimate of the variance of the error of marking with estimates 
both of the variance between candidates and of the variance 

^ For, consider the distribution of marks awarded to the 100 scripts by 
Examiner P. The spread of this distribution is due both to the spread ® 
merit of the candidates and to the random error. If we remove the 
enect, then the situation is equivalent to one where Examiner P marks lu 
candidates of equal merit, and the resulting marks are different only becau^ 
of raimom error. The standard deviation of this random error is an estima 
of cj baaed on 100 cases. The mean of these marks will therefore be subjec 
to error, the extent of which is measured by Now, the means of the 

columns in Table VI are independent of the candidate effect, and, by the previouB 
each is subject to an error, the standard deviation of which ib 
<T jf/vlOO. "V^en, therefore, we calculate the standard deviation of^ these 
^ans, wo obtam a value which is greater than the true standard deviation. 
Wo may write : — 

/Square of calculated staudordN _ /square of true standard \ t £5* 
\doviation between examiners J Vdoviation between examiners/ 

or 100 /square of calculated standard^ 

Vdoviation between oxaminora ) “ 
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between examiners. If, for c.vamplo, <}ie variance between 
candidates is the same as the variance of (ho error, then in 
general we ina 5 ' expect V,/V, — 1. Tin's would mean that 
difTcrcnccs in marks between candidate.s arc not duo to difTcrcnces 
in ability between the candidates. In practice wo should find 
that when the results, not only of this investigation but of all 
similar investigations that might be carried out, are brought 
togetlier, the value of I'./Fj would differ slightly from investiga- 
tion to investigation, but (ho average value for all the 
investigations taken together would be 1. Professor Fisher has 
worked out a, table for the distribution of F./Fj and from his 
table it is possible to find the chances that tlie observed value 
of 1%/F, has occurred b}' random fluctuation alone. Our 
procedure then is to apply Fisher’s Tm( of Significance^ to 
V,/I% and F,/F,. 

77. The next step is to estimate the three standard deviations 
with wliich we are concerned {a,, o-j, and ctj;) from the variances 
Fi, F,, Vt, so (hat <tj„ Cc, and or, nm 5 r be compared. The values 
of Fi, F,, Fj, Fj/F„ and F,/F, are shown in Table VTI. 


TABLE 


Cfttcgorj' 

Essay- 

subject 

Fi 


F, 

Fr/F, 

F,/F. 


A 

40-82 

25-40 

2-14 

19-00 

11-80 


AI 

88-48 

28-48 

3-08 

10-01 

9-26 

(1) 

B 

34 -CO 

28-05 

2-06 

10-81 

13-94 

Sonso 

B1 

24-50 

35-05 

2-10 

11-17 

16-99 


C 

44-08 

27-05 

1-00 

27-95 

17-30 


Cl 

28-97 

27-11 

1-00 

14-76 

13-81 


A 

42-28 

23-43 

1-08 

26-09 

13-90 


Al 

04-00 

27-09 

1-98 

32-40 

13-70 

(H) 

B 

40-23 

20-55 

1-57 

28-83 

16-92 

General 

B1 

37-84 

28-01 

1-03 

23-27 

17-78 

Impression 

C 

47-03 

25-00 

1-30 

34-48 

18-41 

Cl 

35-07 

22-54 

1-43 

24-98 

15-70 


A 

240-48 

32-80 

1-90 

126-43 

17-26 


Al 

215-11 

31-54 

1-76 

122-12 

17-01 

(HI) 

B 

193-02 

34-14 

1-03 

100-12 

17-66 

Spelling 

B1 

202-03* 

29-59 

2-19 

119-90 

13-49 

C 

151-28 

36-70 

2-30 

65-66 

16-49 


Cl 

187-30 

32-12 

2-17 

86-43 

14-82 

» Fisher uses iho function J }og, (VJV,) instead of V,/V, 

in his tables. 

This 

value ho calls r. If, thoreforo, wo wish to find from Fishor s tables tho signlficanco 
of V,/V, wo roust first calculate i log, (V,/V,). 
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TABLE Vn — continued 


Category 

Essay- 

subject 

F, 

F* 

F, 

Fx/F, 

F,/F, 


A 

131-08 

17-77 

1-77 

73-91 

10-02 


A1 

65-23 

28-14 

2-66 

20-76 

10-67 

(RO 

B 

69-14 

21-69 

2-28 

30-27 

9-60 

Punctuation 

B1 

76-61 

22-85 

2-67 

29-79 

8-90 


C 

111-32 

19-30 

2-59 

43-06 

7-46 


Cl 

60-23 

20-03 

2-60 

24-08 

8-01 


A 

181-40 

18-57 

2-01 

90-11 

9-22 


A1 

118-14 

21-60 

2-46 

47-96 

8-77 

(V) 

B 

106-58 

19-01 

2-12 

60-23 

8-96 

Grammar 

B1 

133-47 

20-02 

2-12 

62-92 

9-44 


C 

131-32 

20-13 

3-01 

43-68 

6*69 


Cl 

107-25 

14-89 

2-09 

61-38 

7-13 


A 

43-47 

17-06 

1-44 

30-24 

11-87 


A1 

56-22 

15-66 

1-80 

31-24 

8-70 

(VI) 

B 

57-62 

19-67 

1-51 

38-04 

12-99 

Vocabulary 

B1 

64-80 

18-12 

1-62 

33-81 

11-18 


C 

37-30 

16-98 

1-55 

24-07 

10-96 


Cl 

32-62 

14-49 

1-66 

20-86 

9-27 


A 

49-63 

20-56 

1-66 

29-89- 

12-39 


A1 

56-76 

24-48 ■ 

2-33 

24-40 


(VH) 

B 

72-04 

22-53 

1-91 

37-71 

11-79 

Sentence 

B1 

67-06 

22-07 

1-85 

36-26 

11-93 

Structure 

C 

48-66 

18-07 

1-73 

28-08 

10-42 


Cl 

34-37 

17-12 

1-80 

19-13 

y *ij3 

78. Reference to 

the appropriate tables shows that in 

every 


case the ■variance due to differences beWeen examiners is 
significant. That is, the marks -given by different examiners to 
the same script do differ significantly. This is 'true for ah 
ca'tegories and all essay-subjects. 

79. Similarly, reference 'to Eisher’s tables sho'ws that the 
variance Fj, due to differences in the true merit of candidates 
performances, is significant. This, of course, simply means that 
candidates do differ significantly in essay-'writing capacity and 
that these differences are recognised by the examiners in the 
marks which they allot to the scripts. In other words, the 
dMerences between marks of candida'tes are not merely due' ’to 
chance errors of marking or to differences in points of "view of 
examiners. 
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tablt: \Tn 


Ontogorj* 

Essay-frubjoct 

Est.Vjj 

Est.'nc 

33st.*(T^ 


A 

1-71 

0C2 

1-46 


A1 

1-78 

0-74 

1-76 

(I) 

B 

1-S2 

0-57 

1-43 

Sense 

B1 

203 

0-47 

1-48 


C 

181 

OCG 

1-26 


Cl 

1-77 

0-52 

1-40 


A 

1-G5 

004 

1-30 


A1 

1-77 

0-79 

1-41 

(II) 

B 

1*77 

O-GG 

1-26 

Genera! 

B1 

1-85 

O-GO 

1-28 

Lripression 

C 

1-74 

0-68 

1-18 

Cl 

1C3 

0-69 

1-20 


A 

1-97 

1-C5 

1-38 


A1 

1-93 

1-4C 

1-33 

(ni) 

B 

201 

1-39 

1-39 

Spelling 

BI 

C 

1-85 

204 

1-G2 

1*22 

1-48 

1-62 


Cl 

1-94 

1-3G 

1-47 


A 

1-11 

1-14 

1-33 


A1 

1-70 

0-73 

1-C3 

(IV) 

Punctuation 

B 

1-50 

0-82 

1-61 

Bl 

1-59 

0-8G 

2-60 

C 

1-45 

1-04 

1-61 


Cl 

1-48 

0-76 

1-58 


A 

1-44 

1-34 

1-42 


A1 

1-65 

1-08 

1-57 

(V) 

Grammar 

B 

Bl 

c 

1-45 

1-50 

1-40 

102 
■ 1-16 

1-13 

1-46 

1-46 

1-73 


Cl 

1-27 

103 

1-46 


A 

1-40 

0G5 

1-20 

(^^) 

Vocabulary 

A1 

B 

Bl 

1-32 

1-51 

1-44 

0-74 
. 0-76 

0-73 

1-34 

1-23 

1-27 


c 

1-39 

O-GO 

1-26 


Cl ■ 

1-27 

0-66 

1-25 


A 

1-54 

0-69 

1-29 

(VH) 

Sentence 

Structure 

A1 

B 

Bl 

c 

1-C6 

IGl 

1-59 

1-43 

0-74 

0-84 

0-81 

0-69 

1-63 

1-38 

1-36 

1-32 


Cl 

1-38 

0-57 

1.34 


* “ Est.” is hero tin abbreviation for " Estimates of.” 


D 
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80. Table AT.U gives the values of our estimates of ctc, ctji and 
ffj. The results are interesting. In general, for any essay-subject 
°!s is greater than either cr^ or aj.. That is, in most cases, the 
merit of an essay appears to be the most important single factor 
contributing to the determination of the mark awarded to a 
script. The combined effect of other factors, however, may 
considerably exceed this and indeed does so in all categories 
other than Sense and General Impression.^ It follows, therefore, 
that for categories HI to VII a high mark awarded to a script 
by one examiner may be high as much because of random errors 
of marlMg and the bias peculiar to the examiner as because of 
the merit of the scrip t in respect of that category. 

81. Category (111), Spelling, and category (V), Grammar, 
have values of <rg that are distinctly high, A reference to 
Table 111, giving the average of the marks awarded by each 
examiner for each essay-subject and each category, shows that 
for category (HI) Spelling, the examiners in general award 
higher marks than for the other categories, although this is 

case of Examiner T and is less marked in the cases 
of ^^aminers V and W. The average mark for Spelling awarded 
by Examiner T to all the essay-subjects is very much less than 
the corresponding marks awarded by Examiners P, Q, R, and S ; 
m o^her categories Examiner T awards marks having averages 
T+ ^ order as the average marks of the other examiners, 
womd s^m, therefore, that, when marking for Spelling, 
doing so on a basis very different from that 
ot the other examiners. This wide difference in point of view 
^ S 9 ° ccluse of the large value of for Spelling. 

. tsimilar marked differences between examiners are notice- 
aoie m the case of average marks for category (V), Grammar, 
parricidar, it will be noted that Examiner T awards marks 
^ lower than do the other examiners for this category 
S'? marks regularly higher. 

categories (VI) and (VH), Vocabulary and 
84 tructure, o-p® + is approximately equal to o>“. 

RTin-nr" +1. ^ Gvideuce from the figures in Table VIH to 

snow that cTp IS significantly reduced in the case of directed 

facto^tothetoWvaHnfin^°^°^*^ Br. Smitli here means the contribution of the 
to Xt bv total variance. This is equivalent 

equivalent ^ the Eanare^or wnMouly kno-nui as “ variance ” vhich JS 

i. .1,= ite. 

greater than 0-62= + 1-46* 

The reason 5s (“Ough 1-71 is less than 0-62 + 1.46). 

add variancM.^^ cannot add standard deviations but -n-e can legitimately 
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essay-subjects, neither is there any evidence to show that the 
random errors of marking as estimated by o-^ are different in 
the case of the undirected essay-subject from those in the case 
of directed essay-subjects. 

85. Conclttsio7is. — ^We may summarise the results of our 
analysis as follows : — 

(i) The marks awarded by different examiners to the same 
script do differ significantly. That is, where the marks given 
by two examiners to the same script differ, this difference is 
due in general, not only to random errors of marldng, but also 
to real differences between examiners. 

(ii) The absolute merit of the script does significantly affect 
the marks awarded to it. That is, in addition to the differences 
between examiners there is a significant measure of agreement 
between their marks. 

(iii) Of the three components the absolute merit of the script 
has the greatest effect in determining the mark awarded, but the 
combined effects of the random error and the idiosyncrasy of the 
examiner are probably greater than that of the absolute merit’ 
for all categories except Sense and General Impression. 

(iv) The categories Sense and General Impression were marked 
most satisfactorily ; for these categories the effect of the absolute 
merit of the script was very slightly larger than the combined 
effect of the random errors and the idiosyncrasies of the 
examiners. The categories Spelling, Pimctuation, and Grammar 
were marked least satisfactorily.^ 

(v) In the categories Vocabulary and Sentence Structme, the 
combined effect of examiner differences and random errors is 
approximately equal to the effect on the marks of the absolute 
merit of the candidate. 

(vi) Neither the examiner differences nor the random errors of 
marking axe significantly less for directed than for undirected 
essay-subjects. 

Factor Analysis® 

86. In reading through an essay, the examiner receives a 
number of impressions, the totality of which fuse to give him 

® It is to bo remembored that all these categories tvero marked by impression 
and not by subtraction for errors from a maximum. Bus procedure was 
deliberately adopted in order to avoid tlio great expenditure of time which 
detailed marking of theSo categories would have involved. The object of the 
marking was to ensure that atfonfion should be paid to each of these categories 
before the examiner marked for “ General Impression ” and not to require exact 
estimates for each category. See para. 28 above. — ^P.J.H. 

* For a noto on Analysis of Variance and Factor Analysis, see p. 149 below. 
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a general impression of the candidate’s essay-writing ability. 
It is this that forms the basis of his General Impression mark for 
the script. Different examiners, each reading the same script, 
will all derive from it impressions of the handwriting of the 
candidate,^ his spelling ability, his artistry, his command of 
language, his intelligence and so on, hut they will differ among 
themselves as to the relative weights that they wtU place on each 
of these separate impressions in assigning the final mark. It is 
probable that in awarding their marlcs all examiners are influenced 
to some extent’ by every impression they receive from their 
reading of the script ; but, while, for example, one examiner 
will place great stress on the “ sense ” of the essay, another 
Ym not do so, but will rather look for a high verbal abihty on 
the part of the candidates, and he will not award a high mark, 
however convincingly a candidate has written, if he feels that 
the can^date has not showm evidence of a large vocabulary 
and a high degree of verbal fluency. 

87. When marking for the various categories, the examiners 
were asked to award marks for only one impression. That is, 
e exa,miuer was asked to give, as far as possible, zero weighting 
to all impressions other than the one defined by the category 
un er consideration, so that when marking for Spelling, for 
^ample, he was asked to give no weight to Sense, Punctuation, 
oca ulary, etc. The categories and the objective tests were 
representing the most important underlying influences 
uhely to affect the examiner in making his judgment. By means 
°-i ^ termed Multiple Factor Analysis ” it is possible to 

o am an estimate of the relative importance of these infl uences 
i awa,rded by the examiners for General Impression, 
p-m ^ techmque of factor analysis which we have here 
based primarily on the assumption that marks 
y examiners may be expressed as the sum of a series 
variously weighted. Thus any mark X,, 
form ^ Examiner S to script t may be represented in the 

-f X 2 +a 3 Xs + a„ x„ ... (xiii) 

Sim subscripts on the right-hand side of equation 

which those distinct categories or qualities in the essay 

ueneraMm^,. ^ an important role in producing a 

2 to Snell in script. Thus 1 may refer to Sense, 

Spellmg, 3 to Grammar, etc. The letters a^, a,, a,, etc., 

tho essays factor was oliminatod, as 
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denote the weights a particular examiner s places on the categories 
1, 2, 3, etc. They ma3’- he considered as the proportions of the 
total mark that an examiner assigns to each category. The 
values Xi, Xs, x„ etc., are symbols denoting the marlcs awarded 
by the examiner to the different categories in each script. 

89. Consider the following example : an examiner, in his 
General Impression marking, unconsciously awards, out of a 
possible fifteen, a maximum of ten marks for Sense, two marks 
for SpeUing, two for Grammar, and fractions of a mark for the 
other categories, the total of all these fractions being unity. 
Suppose that the examiner judges the candidate to have for Sense 
an ability which he values as 60 per cent, (say 10 per cent, 
better than the average of his group) ; for Spelling 50 per 
cent., for Grammar 40 per cent. ; and for the other categories 
other percentages. Then the mark awarded by the examiner 
will be : — 

Xj{ = 60% of 10 + 50% of 2 + 40% of 2 -j- other small products 
= 6-}-l+0-S-fa fraction less than 1 
= S marks approximately ... (xiv) 

Another examiner marking the same script and unconsciously 
assigning different weights would, in aU probability, award a 
different total mark to the script. 

90. The factor analysis technique has been applied to our 
data in order to find an answer to the question ; How many 
different values of a in equation (xiii) assume important pro- 
portions with om examiners and what qualities do these different 
a’s represent ? ^ ’ By analysing the values of the correlations 
between the marks of an examiner for each category and his 
marks for each other category’-, it would have been possible to have 

* The fundomontal equations of factor analj'sis aro ; — 

(See L. L. Tliurstone, T/ic Veclors of Mind (University of Cliioago Press, 1935, 

Caiap. I.) 

“l" + “s' + “3* — + “n® = 1 — (j) 

“1^1 'i' “3^3 't “3^3 ‘t ~ ... (ii) 

Tvliere Oj, Oj, cr,, ... o„ are the factor loadings of test a 
6j, 65, 63, ... b„, are the factor loadings of test 6 

Toj being the coirelation between the two tests. It is unlikely that equation 
(ii) holds when we are correlating two sets of marks obtained by asking two 
examiners both to mark one set of scripts. Since the weights that examiners 
give to the same category will differ, and also the impressions the examiners 
gain in respect of that category will differ. Equation (ii) above therefore becomra : 

Ojbjr,, -f* n.6nr23 “3^3^33 ... *i" ^ ... (in) 

where rjj is the corrmation'between the two examiners’ impressions in respect 
of factor 1, etc. 

- In what follows correlation coefficients have been calculated by the Bravais- 
Pearson product-moment formula. 



64 


THE MARKENQ OF ENGUSH ESSAYS 


found the ■weights of various categories entering into his marks. 
This 'would have entailed forty-eight different analyses (there 
being eight examiners for each of six essays). In view of this, 
and remembering that a single examiner’s marks are not as trust- 
worthy as the average mark of a number of examiners, it was 
decided to average the marks of the eight examiners for each 
category and to use these average marks ^ in six analyses (one 
for each essay-subject). 

91. Six tables of correlation coefficients (one for each epay- 
subject) have been prepared (Tables IX to XJV) each containing 
the iatercorrelations of the marks (averaged for the eight 
examiners) for the seven categories, the marks for the intelligence- 
test and the marks of the four other objective tests. Table XV 
may be considered as common to all the Tables IX-XIV ; and 
should form the lower right-hand part of each of them. 


^ Equation (siii) then becomes : — 

^st = Oi -{- Qj x\ ... + a^x' 

where JC,, is the average of the eight marks awarded to one script 

Oj is the average of the weights awarded by the examiners to category i 
a! j is an estimate of the true impression of category I, i.e. an estimate ot 
the average impression of an ihfinite number of competent 
examiners. 
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TiiVBLE XVI 


Iktercomielations bet\veen OBJEcnvB Tests 


Test 

1 

o 

Jj 

3 

4 

5 

1 


0-C50 

0-411 

0-211 

0-551 

2 



0-420 


0-602 

3 





0-635 

4 




— 

0-249 

5 







92. Each, of the Tables above has been analysed by a method 
of factor analj'sis described by Professor Burt. ® 

It ■will be seen that for all of the six Tables of intercorrelations 
the results of the analysis are very similar. In each of these 
six Tables, one factor only is sufficient to account almos 
entirely for the intercorrelations between aU seven categories. 
On remo'ving the effect of this factor a group of small positive 
correlations remains between the objective test 1 (the intelligence- 
test) and objective tests 2, 3 and 5. It was further found that 
these remaining correlations may be accounted for on the supposi- 
tion of a single group -factor common to all of these tests. 
calculated weights of the two factors are given in Table 

93. The factor pattern is difficult to explain. It is probable 
■fchat the high value of the general factor in all the categories 
is due to what is known as a “ halo ” effect. That is, examiners 
when awarding a mark for other categories are unable to free 
their minds entirely from the General Impression, and their marks 
for all categories are really very strongly weighted ■with General 
Impression.® 

94. The group-factor which occurs in objective tests 1, 2, 3 and 
5 may ■tentatively be considered as a vocabulary factor ha^ving 
to do with a knowledge of the meaning of isolated words. K 
should be noted here that the intelhgence-test was largely a 
verbal test. 


^ See footnote (i) on page 65. 

' C. Burt, Brit. J. Ed. Psych., Vol. ■yXI (Part H), 1937. 

^ come to a annilar conclusion from the inspection of the marks and 
tocussioM rvith examiners hoth during the preliminary period, and after toe 
toal mMtogs. But as a matter of fact the examiners marked the scripts for 
Sense firstj^hen for categories HI to VII and Literacy, and finally for General 
^pressiTO. ^e correlation between Sense and General Impression is, however, 
S that the “halo” effect produced by marks for Sense would not be very 
different Horn that produced by General Impression.— P.J.H. . 

six analyse?— factors 1 and 2 retain the same meaning m the 




TABLE XVI « 

Facxou Wntoirrtnaa on Loadinc3 (Sei: i’,uiAa. 87-90) 


STATISTICAL RKrORT 


59 






OH 


o 



CH 




’ f o 

c> — 


P- t* 

CJ 

pj -H 

' cj n 

O 00 

© 

C? 00 

P- o 

*■*3 O 

' CJ 

9 T 

o r5 

9 T 

9 9 


; 

6 6 

O 6 

o o 

6 6 

6 O 

! - 



pH 


Cl 

^ . 


O 

|p 

CO 

© . 

i T 

T [ 

9 1 

'T 1 

9 1 

T 

o ‘ 

o * 

o * 

o * 

o ^ 

© ^ 

1 O 00 

r- 

oc o 

•H CO 

CO CJ 

« © 

1 1**5 t'-* 

« o 

— £C 

***5 © 

p« CO 

to •«< 

1 ts 

9 

9 T 

9 T 

9 V 

CD Cl 

|66 

o 6 

o o 

6 o 

6 6 

6 6 

1 

a n 

e cc 

r- 

CO pH 

O c? 

© Cl 

‘ n 00 

O CO 


I'- to 



, o -r 

9 T 

9 

9 9 

O ic 

CD U|3 

i o o 

6 6 

o o 

o o 

6 6 

6 o 

t C3 ^ 

o 

CO 

Cl CO 

pH CO 

PH Cl 

^ «*■ 

oe o 

Ci « 

O Cl 

p 4 ca 

CO CO 


9 9 

* •? 9 

*? 9 

9 9 

o © 

o o 

1 

o o 

o o 

o o 

o o 

o © 


a 

».-o 


o 

hp 

1*5 


CO 

PH 



9 1 

9 I 

9 1 

9 I 

9 I 

“ 1 

o ’ 

o * 

o * 

o > 


6 ' 

«l 







Cl 


CO 

CO 

CJ 

C5 


C5 


CO 

® I 

i 9 

9 1 

9 1 

9 1 

9 1 

" 

’ o ' 

© * 

o * 

o ' 

o * 

o 

o 

00 

w 

r* 

« 

M 

e* 

o 



pH 


9 1 

9 ! 

9 1 

9 1 

9 1 

1 

6 ' 

o ' 

o ' 

o ' 

o * 

o ' 


o 


n 

© 

00 

CO 

© 

t^ 

^ . 

© 


Cp 1 

9 1 

9 1 

9 

9 1 

“ 1 

6 ' 

o * 

o ’ 

o > 

o * 

o ' 

o 




© 

o 





Cl 

o , 

9 1 

tr 1 

^ I 

9 1 

9 1 


6 ^ 

o ' 

o * 

o * 

© * 

o ' 

00 


a 

Cl 

d 

o 

o 

i6 

^ . 



“ 1 

a 1 

9 1 

9 

. 

9 

9 1 

«? 

o ^ 

6 * 

6 * 

o * 

© ' 

o ' 

rH 

r- 

© 

© 

w 

o 

C5 

cl 


r- . 

c- 

*■■’ 1 

9 1 

9 1 

9 1 

9 

9 1 

» 

O ' 

o ' 

6 * 

o ‘ 

© * 

o ‘ 


pH c\ 

pH d 

pH C^ 

pH d 

i-i ea 


pH 


p-t 




< 


P 

O 

O 


* Soo footnote (•) on pngo fiO. 



60 
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96. Summary of Results. 

(i) Tlie observed correlations in the case of each essay-subject 
may be explained on the basis of one general factor. 

(ii) The general factor may best be described as a General 
Impression factor. 

(iii) The magnitudes of the factor are similar for directed 
and undirected essays. 

(iv) In the objective tests 1, 2, 3, and 5 we have found in 
addition to the general factor a group-factor which has been 
tentatively described as a verbal factor. 


The Re-Mahking op Schipts (see paras. 36 and 44 above) 

96. In order to test the “ self-consistency ” of the examiners 
it was decided to ask them, after an interval of five months, to 
re-mark representative samples of the scripts. For this purpose 
six samples, each consisting of twenty scripts, were chosen, one 
sample for each essay-subject. These were marked by the same 
eight examiners under the same instructions as before (see para. 
36 above). Each examiner marked each Script eight times ; 
^ce each for the categories. Sense, General Impression, Spelling. 
Punctuation, Grammar, Vocabulary, Sentence Structure, and 
Literacy. 

97. The Tables XVII (1) to XVII (6) give the marks awarded 
by the eight examiners, on re-marking, to the selected representa- 

ive candidates whose marks at the &st markings are given in 
^les II (1) to II (6). It will be noted that there are large 
oiiierences between marks awarded to the same script by the 
same examiner on the two occasions in all categories. 

nn index of the consistency of marking we have used 
e ^rrelation coefl&cients obtained by correlating the marks 
awarded on the first occasion with those awarded on the second 
occasion by the same examiner. Correlation coefficients^ have 
een (mlculated for each essay-subject and for each category 
jexclu^g Literacy, which was treated separately). The 336 
TaWe X^n correlation coefficients so obtained are shown in 

Pea^n coefficients were calculated by the Bravais- 
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TABLE X%TI (1) 

Essay-sobject a — ^Re-siabkino 


Cnnd. Maries awarded to Scripts by Examinors 
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Category 
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table xvn (2) 

Essay-subject A1— Re-mabking 

Cand. Marks awarded to Scripts by Examiners 
Q B S T TJ V 
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TABLE X\TI (3) 
EssAV-stJBjEcr B — Rd-makking 


Cntcgorj- 
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Maries awarded to Scripts by Examiners 
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TABLE XVII (4) 
Essay-subject B1 — ^Re-siarking 


Cand. Marks awarded to Scripts by Examiners 
Category No. PQRSTUVW 
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TABLE XVn (5) 
Essay-subject C — RE-UABKiKa 


Cand. Jfnrks tivrnrdcd to Scripts by Esaniinera 


Category 

No. 

P 

Q 

R 

S 

T 

U 

V 

W 


O 
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8 

6 
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6 

10 

8 


32 
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6 

4 
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(I) 

36 
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10 
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41 

12 

12 

8 

10 

12 

10 

11 

11 


93 
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96 

12 
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10 
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14 
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14 
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10 

10 
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7 
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41 

11 

12 

11 

10 

12 
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11 

11 


93 

7 

6 

6 

5 

8 

8 

7 

4 


95 

11 

10 

12 

11 

10 

12 

11 

13 
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7 

6 
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11 

10 

6 


32 

7 
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14 
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8 

7 

8 

(V) 

36 

8 

9 

14 

11 

11 

8 

9 

11 

Grammar 

41 

11 

12 

14 

12 

11 

11 

11 

12 


93 

7 

8 

12 

8 

8 

5 

7 

6 


96 

11 

10 

14 

11 

11 

11 

12 

12 
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8 

7 

8 

9 

8 

10 

8 


32 

6 

8 

9 

10 

9 

8 

8 

9 

(VI) 

35 

8 

8 

8 

10 

9 

8 

• 9 

9 

Vocabulary 

41 

12 

12 

7 

9 

11 

11 

11 

11 

93 

S 

7 

7 

8' 

8 

8 

7 

5 


95 

10 

11 

8 

8 

H 

11 

12 

12 
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7 

8 

8 

9 

10 

8 


32 

6 

8 

8 

9 

8 

7 

7 

8 
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35 

7 

8 

8 

9 

10 

8 

9 

7 

Sentence 

41 

11 

12 

8 

8 

12 

6 

11 

11 

Structure 

93 

7 

6 

6 

8 

8 

6 

7 

4 


95 

9 

11 

8 

8 

12 

11 

12 

12 
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TABLE XVn (6) 
Essay-sttbject Cl — ^R e-maeking 



Cand. 

Marks awarded 

to Scripts by Examiners 


Category 

No. 

P 

Q 

R 

S 

T 

U 

V 

TV 


26 

11 

10 

9 

9 

13 

11 

11 

12 


37 

8 

9 

7 

8 

9 

6 

10 

8 

66 

11 

8 

6 

8 

7 

7 

9 

7 

c 

Sense 

68 

12 

12 

12 

10 

14 

14 

11 

14 


82 

8 

8 

6 

7 

8 

8 

8 

7 


96 

11 

11 

11 

8 

13 

11 

10 

12 


26 

9 

9 

7 

8 

13 

10 

11 

9 


37 

7 

9 

7 

- 8 

9 

7 

10 

8 

66 

9 

8 

6 

8 

7 

8 

9 

7 

r, 

General 

Impression 

68 

82 

9 

7 

13 

9 

11 

6 

11 

7 

14 

8 

14 

9 

11 

8 

14 

7 


96 

7 

11 

9 

8 

12 

11 

10 

10 


26 

10 

11 

14 

8 

11 

7 

11 

6 

o FI) 

Spelling 

37 

11 

12 

14 

8 

9 

8 

10 

6 

66 

68 

13 

14 

14 

14 

14 

14 

11 

13 

8 

14 

11 

14 

9 

11 

8 

14 


82 

12 

14 

14 

11 

10 

11 

9 

7 


95 

13 

14 

14 

11 

11 

12 

10 

12 


25 

6 

8 

7 

7 

14 

9 

11 

8 

■tTinctuation 

37 

7 

9 

8 

8 

8 

11 

10 

8 

66 

68 

8 

8 

8 

13 

7 

13 

8 

11 

8 

14 

11 

14 

9 

11 

8 

13 


82 

7 

10 

13 

8 

8 

11 

9 

8 


96 

7 

11 

12 

8 

11 

12 

10 

7 


25 

7 

10 

7 

8 

14 

11 

11 

10 

Grammar 

37 

8 

9 

14 

8 

9 

10 

10 

11 

66 

68 

10 

8 

8 

13 

12 

12 

8 

11 

8 

12 

10 

13 

9 

11 

8 

14 


82 

8 

10 

13 

8 

11 

11 

9 

8 


95 

8 

11 

11 

11 

12 

11 

10 

11 


26 

9 

10 

9 

8 

12 

10 

11 

9 

^ (VI) 

Vocabulary 

37 

66 

68 

7 

8 

11 

9 

8 

13 

8 

8 

12 

8 

8 

11 

9 

8 

14 

8 

8 

14 

10 

9 

11 

10 

8 

14 


82 

7 

9 

8 

8 

8 

10 

8 

8 


95 

7 

11 

8 

8 

12 

11 

10 

7 


25 

7 

9 

8 

8 

13 

11 

11 

7 

(vn) 

Sentence 

37 

66 

6S 

7 

8 

9 

8 

7 

6 

7 

8 

9 

7 

8 

6 

10 

8 

9 

7 

Stmctme 

82 

7 

6 

12 

8 

11 

7 

11 

8 

14 

8 

14 

11 

11 

8 

13 

7 


95 

7 

11 

8 

8 

12 

11 

10 

9 
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TABLE XVin 

ConnELATIOKS BETWEEN PlnST AKD SeCOES MaBKINOS OF 120 SCMPTS 
(20 for cnch Essay. subject) 


Examiner 


Category 

Essay 

B 

Q 

R 

S 

T 

U 

V 

W 


A 

0-90 

0-fi9 

0-7G 

on 

0-68 

0-78 

0'67 

0'90 

(I) 

A1 

0-56 

0-24 

0-58 

0'C9 

0-64 

0-70 

0'48 

0'G7 

Sense 

B 

0-73 

0-49 

0-74 

on 

0-74 

0-79 

064 

0'54 


B1 

0-86 

0-82 

0-73 

0-76 

0-70 

0-83 

0'29 

0-61 


C 

0-79 

017 

0-47 

O'GG 

0-67 

0-74 

0'49 

0'84 


Cl 

0-17 

0-70 

0-67 

0-70 

0-04 

0-81 

0'68 

O'GG 


A 

0-92 

0-88 

0-74 

0-81 

0-83 

0-77 

0'C5 

0'86 

(H) 

A1 

0-70 

0-40 

0-76 

0-67 

0-09 

0-44 

0'03 

0'G8 

General 

B 

081 

0-71 

0-80 

0-83 

0-80 

O'GG 

0'44 

0'79 

Impression 

B1 

0-96 

0-74 

0-83 

0-78 

0-77 

0'73 

0-13 

0-87 


C 

0-75 

0-70 

0-58 

on 

0'G5 

0'71 

0'67 

0'83 


Cl 

0-43 

0-80 

0-44 

0-82 

O'GG 

0'85 

0-22 

0'80 


A 

0-93 

0-94 

0-70 

0'G8 

0-84 

0'G9 

0-61 

0'71 

(m) 

A1 

0-76 

0-8G 

0-72 

0-90 

0-71 

0'82 

0'G4 

0-70 

Spelling 

B 

0-84 

0-88 

0-7G 

0-92 

0-86 

0'78 

0-69 

0'89 


B1 

0-89 

0'92 

0-8G 

0-83 

0-72 

0'03 

0'31 

O'SG 


C 

0-09 

0-72 

0-66 

0-82 

0'G3 

0'82 

0'79 

0-69 


Cl 

0-42 

0'43 

0-2G 

0-81 

0'C5 

0'46 

0'27 

0'88 


A 

0'92 

0-83 

O-GO 

0'G8 

0-77 

0'74 

0'63 

0'78 

(IV) 

A1 

0'G7 

0-48 

0-82 

0-77 

O'GI 

O'GI 

O'GO 

0'7G 

Punctuation B 

0-80 

0-48 

0-88 

0G3 

003 

0'68 

0'41 

0'61 


B1 

0-89 

0-82 

0-81 

0'8G 

0-76 

0'G7 

-0'04 

0'76 


C 

0-08 

0-4G 

O' 80 

0-73 

0-17 

0'40 

O'GI 

0'83 


Cl 

0-40 

0-CG 

0-67 

0-61 

0-49 

0'29 

0'65 

O'GI 


A 

0-87 

0-79 

0-4G 

0-73 

0-77 

0-31 

0'6G 

0'7G 

(V) 

A1 

0-25 

0-50 

0G2 

0'40 

0'3C 

0'17 

0'69 

0'60 

Grammar 

B 

0-C5 

0-G7 

0G9 

0-20 

0-78 

0'70 

0-27 

0'G5 


B1 

0-71 

0-72 

0-73 

0-67 

0-77 

0-31 

O'OG 

0'74 


C 

0'67 

0-48 

0-49 

0-68 

0-42 

0'45 

0'45 

0'63 


Cl 

014 

0-G9 

OGl 

0-72 

0-19 

0-31 

0'55 

0'C9 


A 

0-91 

0-77 

0G7 

0G7 

0-84 

0'33 

0'51 

0'84 

(VI) 

A1 

0-(i8 

0-43 

. 0-43 

0-49 

0-52 

0'23 

0-63 

0-59 

Vocabulary 

B 

0-78 

0-40 

0-87 

0-73 

0-62 

0'4G 

0'64 

0'66 


B1 

0-89 

0-80 

0-G7 

0-79 

0-78 

0'G6 

O'll 

0'80 


C 

0-09 

0-66 

0-61 

0-72 

0-42 

0'36 

0'55 

0'67 


Cl 

0-42 

0-7G 

O' 46 

0-66 

0-41 

0'69 

0'56 

0'76 


A 

0-93 

0-82 

0-83 

0-83 

0-90 

0'69 

O'GO 

0'74 

(vn) 

A1 

0-56 

0-29 

0C8 

0-34 

0-64 

0'62 

0'62 

0'4I 

Sentence 

B 

0-C5 

0-79 

0-72 

0'G8 

0-74 

0-68 

0'4G 

0'69 

Structure 

B1 

0-91 

0-71 

0-76 

0-87 

0'G3 

0'41 

0'07 

0'82 


C 

0-66 

0-66 

0-28 

0-79 

0-16 

0'36 

0'69 

0'73 


Cl 

0-43 

0-47 

0-38 

OG5 

0'6G 

0'39 

0'23 

0'62 


08 


TJtr. MAltKINO <)T- nKOW.SH fXS.HAYrt 


08. It will be observed timt llierc if! in tbo whole table a 
ver}’ wide range of vnliir-a of correlation coefficients which vap' 
from ~0-0 t (in one instance) to 0-nr». Wide %'nriations occur in 
the values for any one o.ssay-.sjibject, in the values for any one 
category, and even in the vnhios for any one examiner. If 
had cho.scn different samples of 20 scripts for each essay-subject 
for ro-mnrlcing, the calculated correlation coefficients would bavc 
been slighth' different. Wo may regard tlic correlation co- 
efficients shown in Table XVIJI ns estimates of the true correlation 
(the average for an infinite number of samplc-s between marks 
awarded on the two occa.sions). 

It is possible to calculate the probability that an individual 
correlation coefficient in the table rcjircsents a measure of real 
agreement between the marka (i.c., a true correlation greater than 
shall accept ns significant tboso correlation co- 
efficients for which the clianccs are 100 to 1 that they represent 
^ ^™®,®®'^Glation greater than zero. Only values of correlation 
coefficients greater than 0-56 satisfy this requirement. In other 
vords, if we put lo red halls marked 1 to 15 in one hat, and 15 
black balls marked 1 to 15 in another lint, and take out a red ball 
and a black ball blindfold and note the numbons, replacing tho 
^ alls and making twenty such selections, we should expect once 
m one hundred such sets of twenty choices, to find one value of 
e correlation between the red and the black numbers fo be as 
Of the 330 correlation coefficients in Table XVIHi 
reach our criterion of significance. 

. ihe consistency’^ of mnrlnng of any one examiner varies 
irom essay-subject to essay-subject. Examiner P, for example, 
s ows igli consistency in his marks for essay-subject A in all 
gones, and low. consistency in his marks for essay-subject 
The results of Examiner V show in all 
aregones little consistency ; indeed, in one instance (marks 
essay-subject Bl) the marks on the second 
x. actually correlate negatively \^ath the marks for the 
Essay-subjects C and Cl appear to have been 
to f>\in consistency in all categories. There is notliing 

consistency of marldng of the other four 
nressinn general, the categories Sense, General Im- 

bnt fliAT-o ^ Spelling have been marked most consistently, 
resnect ^ every category differences in consistency in 

nio ““’“tosis «nd of essay-Bubjoots. 

essavs Wp XYHI that the directed 

essavs Thp consistently marked than the undirected 

y . The differences of consistency, in general, between the 
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luarldngs of the directed and undirected essays, are not significant, 
Aritli the possible exception of those between the markings of 
essay-subjects A and Al. Here there is some slight evidence that 
the tmdirected essay-subject A has been marked more consistently 
than the directed essay-subject Al. Examiner P marks the 
undirected essays more consistently in all cases ; this is not 
true for anj’^ of the other examiners. 

101. We should expect the correlation between two markings by 
one examiner for the same category to be higher than the inter- 
correlations between the marks awarded by him for different 
categories. But this is not the case in our experiment ; compare 
Tables IX to XIV with Table XVlli. In order to understand 
the reason for this the initial marlis assigned to one hundred 
scripts for each category were examined in respect of each 
examiner separately. It was found that there was a strong 
tendency for examiners to award to a script the same marks for 
each category. Tliis “ halo ” effect is particularly noticeable 
in the case of essay-subject Cl (see para. 93 above), for Examiner 
V, where identical marks were awarded to all seven categories 
for 48 of the 100 scripts, and for 93 of the 100 scripts identical 
marks were awarded to foior or more categories 1 The “ halo ” 
effect between categories is much greater in the case of Examiner 
V than for any of the other examiners, yet the awards of all the 
other examiners show a similar tendency. The effect of this 
tendency on the part of the examiner is to produce an abnormally 
high correlation between his marks for the different categories. 

102. The coeJGScient of correlation between the first and 
second marldngs is not of itself a complete measure of con- 
sistency.' 

We must ask two further questions : — 

(i) Is the standard deviation of the marks the same for the 

first and second markings ? 

(ii) Is the average mark the same for the first and second 

marldngs ? 

If, for example, an examiner on re-marldng twenty scripts 
exaggerates the value of good scripts by awardhig higher marks 
than at the first morldng, and depreciates the value of poor 
scripts by giving lower marks than on the first marking, he may 
stUl rank the scripts in the same order of merit and so have 
perfectly correlated sets of marks yet no two marks awarded 

» See B. TV. B. Jackson, on tho “ Reliability of Mental Testa,” Brit. J . Psych., 
XXrX, Part 3, p. 267 (1939). 
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to the same script may be the same. Again, if his standard of 
severity changes from the first marking to the second, then 
the rank order of the marks awarded may be the same on the 
two occasions yet all the marks on the second inarldng may he 
lower, or all may be higher, than those on the first marking. 
Our results show that for the first and second marking of the 
twenty scripts there are both diflferences in standard of marking 
and differences in spread of marks awarded, irrespective of the 
correlation between the two sets of marks. 

Consider, for example, the following results for 20 scripts 
marked by Examiner T. 


Essay-subject B 
Category IV, Punctuation 

^Bt Marking 2nd Marking 
Mean 7-05 9-76 

Standard 

Deviation 1.47 2-24 

Correlation 0-627 


Category VI, Voedbulary 

\at Marking 2nd Marking 
7-95 10-46 


1-91 1-67 

0-620 


There is here no significant difference between the correlation 
coefiicients. In both cases the average mark awarded on the 
second marking is significantly greater than that on the first 
marking. The standard deviation of the second marking for 
Bimctuation is significantly larger than that of the first marking* 
here is no significant difference between the standard deviations 

0 the first and second markings for Vocabulary. 

103. As we have pointed out above, while correlation- 
coei^ients and standard deviations give valuable information 
on the statistical relations of two series of figures, they fail to 
give some of the most important facts needed by examiners and 
examinmg bodies, which can only be obtained by comparing 
e actaal marks awarded. We have given above the actual 
marks for aU the categories for the two markings of 6 samples 
ot essays for each essay-subject. In Tables XIX (1) to XIX (6) 
e ow, we give the marks for General Impression, awarded by all 
e examiners at the first and second markings of the whole set 

01 scripts which were re-marked. The marks for General 

* considered for certain purposes as the most 

important of all, because they were aUotted after the examiners 

categories, and because the examiners 
TMrlrn marks for General Impression were the 

tien awarded at a School Certificate examina- 

tn a from the obligation to pass or give credit 

to a stated percentage of the candidates (see para. 35 A%dfin.). 
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103a. In Table XIX (7) are summarised the number and 
magnitude of the 120 differences between the first and second 
markings of the different examiners for General Impression. 

TABLE XIX (7) 

NtTiiBEn AND Magnitude of Differences between the First and 
Second Markings of the different Exasiiners for General 

Impression 


Differences Examiners 

between 1st 


and 2nd Mnrldng 

P 

Q 

R 

S 

T 

U 

V 

W 

0 

51 

34 

35 

42 

9 

34 

26 

31 

1 unit 

44 

57 

48 

43 

28 

48 

60 

62 

2 units 

15 

19 

16 

30 

33 

29 

27 

22 

3 units 

7 

8 

14 

4 

24 

7 

10 

9 

4 units 

3 

1 

7 

0 

21 

2 

6 

5 

5 units 

0 

1 

0 

1 

4 

0 

1 

1 

G units 

0 

0 

0 

0 

1 

0 

0 

0 


120 

120 

120 

120 

120 

120 

120 

120 


Two of the examiners differ from the rest, Examiner P in his 
consistency and Examiner T in his want of consistency. The 
number of cases out of 120 in which the difference between the 
two markings of an examiner does not exceed one um‘t on the 
fifteen-point scale (G-67 on a hundred-point scale) is shown 
below : — 

P Q R S T U V W 

96 91 83 85 37 82 70 83 

It is to be remembered that a unit difference may be positive 
or negative and that within the group for which an examiner’s 
differences are of one unit only, two candidates who were marked 
by him as equal in the first instance may be awarded marks 
differing by two units (or over 13% on a 100-point scale) in the 
second instance. (Take for instance P’s marks for candidates 
No. 36 and No. 72 for Essay A.) The second markings even of 
the most consistent Examiner P differ in three instances by four 
units (or 26-6% on the hundred-point scale) from his first 
markings. Differences such as these may very seriously affect 
the fate of candidates. 

103b. The following tables show the average differences 
between the first and second markings of 120 essays for the category 
General Impression. In Table XIX (8) the signs are included in 
calculating the averages ; in Table XIX (9) they are all taken as 
positive. 
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Tirr, .MAiiKiKo or knolish kssavs 


TABLIC XIX (8) 

Avkiiaoeb of Tjm Dirrnnr.r.'cn** iirrrxvnnx the 1i>t a:j» 2.*."D JtAiiKnfos 
or 8 EXAiiiN'Kiis ron Gkvkiux IstmEs.tio.v (20 scnirrs ron EAcn 

Ks3AV-8oiiJKcr) 


[The nujns of the flrvinliotu from the average arc irieludedy 


Examiner 

P 

Q ~ 

n 

s 

t’ 

U 

V 

W 

Avemgo 

Essay 

A 

-i-o-ir. 

-0-05 

-o-.'i.'; 

-)0-r.o 

-}-2-10 

-0-40 

-fO-45 

-0-35 

0-2fi 

*1 

A1 

+0-75 

-O-Co 

-0-95 

+0-80 

-i-3-05 

-0-25 

-4-0-80 

-0-30 

0-41 

»» 

B 

-fO-10 

-0-05 

-1-05 

+0-75 

-f 2-50 -fO-50 

-4-1-50 

.fO-90 

0-61 

• * 

B1 

-fO-20 

f0-40 

-1-00 

— O-CO 

-4-1-80 -1-0-20 

-I-0-35 

-0-05 

0-16 

f* 

c 

+0-55 

-0-C5 

-0-10 

0-00 

-H-45 - 

-1-50 

-4-1-05 

4-0-05 

0-12 

»» 

Cl 

-0-70 

-i-O-IO 

-1-05 

-0-05 

-h2-10 

-0-30 

•4-0-70 

4-0-15 

0-12 

Average 

1 rvu^ . 

+0-23 

-0-23 

1 

O 

-fO-23 -4-2-17 - 

-0-29 -4-0-81 

4-0- 07 

0-278 


Tho 4- sign indicotcs tlmt the /ioeond marking wna greater than the first. 


TABLE XTX (P) 

[All the sigiiK of the lieviationt from the average have been taken as +] 


Examiner 

p 

Q 

R 

S 

T 

U 

V 

U' 

Average 

Essay A 

0-55 

1-05 

1-35 

1-40 

2-10 

1-00 

1- 

25 

1-16 

1-23 

•, A1 

1--15 

1-25 

1-45 

1-10 

3-05 

1-45 

1- 

10 

1-90 

1-69 

II B 

0-90 

1-35 

1-25 

0-95 

2-50 

1-20 

1- 

•90 

1-50 

1-44 

ti B1 

0-30 

1-00 

1-20 

MO 

2-10 

1-00 

1- 

C5 

1-05 

1-18 

*» C 

0-95 

1-05 

0-80 

0-50 

1-75 

1-00 

1- 

15 

l-05\ 

MI 

II Cl 

1-20 

0-70 

1-45 

0-95 

2-30 

0-50 

1- 

•10 

0-75 

M2 


0-89 

1-07 

1-25 

1-00 

2-30 

1-13 

1- 

•30 

1-23 

1-278 


Remarks : 


shows that Examiners T and V gave higher marks on the 
ToftrUa essays. Examiner R, on tho other hand, gavo lower 

ffreatoT- ^ each of these cases the average difference is 

the average difference of all tho O-xaminers {0-278). Tho variability 
va^Ba^f>l ^ shown in Table XIX (9), which gives tho absolute 

values of the differences regardless of sign. 

liiebir tif whole, the examiners have tended to mark Essays A1 and B much 
mgner on the second markings. 

on thn tho marks of Examiner T, whose awards 

than on +>i ^ fl "w^Gre more than 2 marks out of a maximum of 15 higher 

e t, the differences for tho remaining seven examiners ore : — 


Essay A 

Average Differences 
with Sign 

-0-007 

Average Differences 
with all Signs taken 
as positive 

1-11 

II Al 

4-0-029 

1-39 

II E 

4-0-336 ■ 

1-29 

•1 Bl 

-0-071 

1-04 

II C 

-0-071 

1-01 

II Cl 

-0-164 

0-96 

Average 

0-018 

1-132 
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103a. The average ranges for General Impression (i.e. the 
averages of the differences between the highest and the lowest 
marks for that category of the different examiners for the different 
scripts) were as follows : — 

Average Ranges at the First Marking of 600 scripts. Essay- 
subjects : A, 4-03; Al, 4-44; B, 3-79; Bl, 3-81; C, 3-74: 
Cl, 3-63. 

General average for the 600 essays (on the fifteen point scale) 
3-91. 

Average Ranges at the Re-marking of 120 scripts out of the 600. 
Essay-subjects: A, 3-16, ■ Al, 4-10 ; B, 4-30 ; Bl, 4-45 ; 0,3-55: 
Cl, 3-90. 

General average for 120 essays (on the fifteen-point scale), 3-91. 


The exactness of the agreement of the general averages in the 
two cases is of course due to chance. 

Examples of the actual marks awarded by the different 
examiners will be found in Tables II (1) to II (6 ) ; in Tables 
XVn (1) to XVn (6) ; and, for 120 essays, both at the First 
Marldngs and, at the Re-marking, in Tables XIX (1) to XIX (6). 

104. The marks for Literacy have been considered separately 
(see pp. 80-92 below). It wiU be seen from Table XXV on p. 85 
below that out of every six verdicts one was changed (169 out 
of 960). The largest niunber of changes was from “ Doubtful ” 
in the first marking to “ Yes ” in the second marking — 90 in aU. 
There were 21 changes from “ No ” to " Yes,” and 5 changes 
from “ Yes ” to “ No,” Examiner T made far more changes 
than any other examiner. 

105. Gonclnsions : We may summarise as follows the con- 
clusions derived from the results of re-marldng : — 

(1) The consistency of marldng as measured by correlation 
coefScients varies with the essay-subject, but there is little 
evidence of differences in consistency of marking between the 
directed and the imdirected essays. 

(2) Examiners’ marks awarded to the same script on two 
occasions vary considerably, in some instances, both in the 
standard deviation and the mean as well as in the rank order of 
the marks. 

(3) The consistency of marldng varies with the examiner and 
the results emphasise the need for choosing examiners carefully.^ 

^ It Bhould be added that, bo far os we are aware, examining bodies atpresent 
do not regularly test tlio consistency of the examiners in the way in which they 
were tested during the present invostigotion, — 



CHAPTER V.— LITERACY AS A CRITERION AT THE 
SCHOOL CERTLFICATE STAGE 


106. In an official report on the School Certificate Examination 
published in 1932 the following sentences occur : — 

(1) The Investigators are in agreement with those Examining 
bodies who take steps of one kind or another ... to prevent 
the award of certificates to candidates who can only be classed 
as “ illiterate.” 

(2) In the case of candidates taking English as a group 
subject they would have no difficulty in detecting ^nd 
sentencing sheer “ illiteracy.” » 

The objective of the Investigators seems a reasonable one at 
fcst sight. ^ But, when we try to define the words “ literate ” and 
illiterate,” and “ literacy ” and “ illiteracy ” in their application 
to candidates for the School Certificate and their work we are 
confronted with difficulties not immediately apparent. 

107. The Oxford English Dictionary assigns a niunber of 
meanings to the word “ literate ” and its opposite “ illiterate, 
of which we need only discuss two. 

The word “ literate ” may mean a “ liberally educated or 
learned person ” ; and it may have the widely different and much 
more frequent meaning of a person who “ can read and wr^ 
opposed to iUiterate.” Neither of these meanings would be 


Certificate Examination ; being the Report of the Panel of 
Secondary Schools Examinations Council 
Approved School Certificate Examinations held m the 
Stationery Ofiice, 1932), para. 70. Quoted in Essays 
, ^ic^ael Sadler and others (Macmillan, 1936), p- 1^2. 

their methods Tvhich the Investigators recommended for attaining 

18 Julv i adopted. In Circular 1463 of the Board of Education of 

(whi^^had ’^commended that success in an English language test 

sWd be Northern Enivemties Joint Bowd) 

reouirement d® a conation for the award of the School Certificate, and ^ 

midW thet^- School Certificate Authorities m 193® 

unu uy tne remainmg one in 1940. 


80 
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of any practical value in judging the vork of candidates for the 
School Certificate Examination, for the simple reason tha,t, 
broadly speaking, none of such candidates would be literate in 
the first sense, and all of them would be literate in the second. 
108. The problem which we set ourselves was this 
Is it possible to devise a definition of literacy suitable for 
the particular purpose of the Investigators ? As has been stated 
above, our Sub-Committee and our examiners found the task 
beyond their powers. They could not agree. Nevertheless it 
seemed possible that, although the examiners could not agree on 
a verbal definition of the requirements which they had in mmd, 
they might, in practice, find themselves able to reach a fair de^ee 
of agreement in judging whether any particular scr^t satisfied 
their literacy requirements or not. K they coifid find sue 
reasonable measure of agreement in 
ticular School Cert.ificate essay did or did not show 
literacy, the absence of a definition, though regrettable, wodd not 
be fate! to the use of the word literacy for the 
the Investigators. The matter was therefore ® 

each one of our 600 essays was marked 
by each of the eight examiners. At a later ^ 

essaj^ were re-marked for literacy, as we 122 below 

cateeories bv the same examiuers ; see paras. 117-1^^ ^ 
"o^Se examiners felt that it wo^d be 
literacy the fifteen-point scale used ™ .Wefore 

categories, and for this further J .< Doubtful ”), 

marked on a three-pouit scale as xes, • P-e-. 

°"l'lo! men the marks thus awarded to the scripts by the eight 
examiners were either 

(i) Yes, Yes, Yes, No, N®. ?. 

or (ii) Yes, Yes, Yes, No, No, ?, ?. 
or (iii) Yes, Yes, No, No, No, 

showing a maximum of only 
these scripts were considered as J^^t^tes, of course, the 

three examiners m agreement , examiners using 

widest possible di^agreenient between th ig 

the system above described. , S 4 5, 6, 7 and 8 

ThVnumte of »ses tor wh.* ^ ^ 

examiners in agreement are shown 
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TABLE XX 


XtTMBEES OF OASES IK WHIOH DIFFEBENT NTTMBEBS OF EXAMINEKS 
AGREE IN MARKING FOR LiTEBAOy 


Maximum number of 
Examiners who agree 
See para. 74 

3 

4 
6 
6 

7 

8 


Number of Scripts for each Essay-subject on 
the Examiners agree 

A Al B B1 C 

which 

Cl 

4 

3 

3 

1 

2 

2 

8 

9 

12 

6 

6 

7 

16 

17 

13 

13 

9 

9 

16 

16 

13 

21 

10 

12 

29 

27 

16 

13 

11 

16 

29 

29 

44 

46 

63 

64 

— 











100 

100 

100 

100 

100 

100 


+ 1 , seen that the judgment of the examiners in regard to 

me literacy of the can^dates varied with the subject of the essay. 
• ® of cases in which the whole eight examiners agreed 

m their awards was only 29 for subjects A and Al, but rose to 
64 for subject Cl and to 63 for subject C." 

11. We have not attempted to ascertain in any detail whether 
e numerical results showed any sex-difference in respect of 
racy, but the following statistics of candidates who received 
e award of ‘ Yes ” for literacy from all the examiners indicate 
eupenonty of the girls in this respect. 


TABLE XXI 

XtTKBER OF Candidates marked “ Yes ” for Literagy by am. the 


EIGHT EXAJUNEBS 


Essay-subject 

A 

Al 

B 

B1 

C 

Cl 

Girls 

18 

18 

27 

26 

38 

31 

Boys 

11 

11 

17 

20 

26 

23 


158 

107 


shows the percentages of the three 

eSerXtbo “ Doubtful,*’ allotted by the 

examiners for the different essay-subjects. 

b grecment from A to C woa not duo to incroosing prnctico. 



table xxit 

PcncnNTAOES or Tn.r. Tnr.cn awahoh »«„ . ^ 

DrrnmrsT ExAMincit^ ron sLVi'f *'‘'' 


Essay -subject Ma rk 
A “ 


A1 


B 


B1 


Cl 


Yes 

Doubtful 

No 

Yes 

Doubtful 

No 

Yes 

Doubtful 

No 

Yes 

Doubtful 

No 

Yes 

Doubtful 

No 

Yes 

Doubtful 

No 


70 

21 

0 

73 

17 
10 

CS 

25 

7 

78 

18 
4 

73 

19 

8 

79 
IG 

6 


-9-_ 

90 ' 
4 

C 

87 

9 

4 

91 
8 
1 

93 

3 

4 

95 

3 

2 

90 

2 

2 



113. Table XXm below shows the ranges of tl . 
for eaeb examiner and each award. ^ 


P'^'-centages 


TABLE XXIU 


Xir.P 

Yes 

Doubtful 

No 

Err. n 

Yes 


i/arimum 

79 (Cl) 
25 (B) 
10 (Al) 


J/infmum 

68 (B) 
10 (Cl) 
4 (Bl) 


RaxiQt 

11 

9 


94 


Doubtful 11 


No 


(Bl 

& Cl) 88 (A) 

(A) 6 (Bl 

&C1) 
(C) 1 (A, B, 

B1,C1) 


£xr. Q 

Yes 

Doubtful 

No 

Err. a 

Yes 


J/^arfmum 
90 (Cl) 
9 (Al) 
C (A) 


93 (C) 
Doubtful 12 (B) 


No 


9 (A) 



87 (Ai) 
2 (Cl) 
1 (B) 


82 


(Al) 

(C) 

(B) 


ll 

10 


» The symbol within paronthosos following a percentage shows the essay bi.» i 
for which the percentage was given by the erammor in question. ^ "'leet 


question. 
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TABLE XXm — continued 

JSxr. T 

Marimum 

Jfinimum 

Range 

Exr. a. 

Maximum 

Minimum 

Range 

Yes 

72 (C) 

34 (A) 

28 

Yes 

97 (C) 

69 (Al) 

38 

Doubtful 46 (A) 

21 (C) 

26 

Doubtful 

18 (Al) 

0 (C) 

18 

No 

20 (A) 

7 (G) 

13 

No 

23 (Al) 

3 (C) 

20 

Exr. r 




Exr. ir 




Yes 

100 (Cl) 

83 (Al) 

17 

Yes 

81 (C) 

61 (A) 

20 

Doubtful 

11 (Al) 

0 (Cl) 

11 

Doubtful 

12 (Al, 








B, Cl) 

7 (C) 

5 

No 

6 (Al) 

0 (B, 








Bl, Cl) 6 

No 

31 (A) 

11 (Al) 

20 


114:. Table XXIV below shows the wide differences of standard 
of the different examiners in the form of the percentages of 
awards of “ Yes,” “ Doubtful,” and “ No ” which they assigned 
to all the essays taken together (on their first marking). 



Taking the two lowest and the two highest percentages for 
each award and for the different examiners, we find the 
following : — 


““ Yes ” 

“ Doubtful ” 
“No” 


Loweet Percentages 
T, 51-6% ; W, 73-8% 
V, 3-8% ; Q, 4-8% 
R, 1-6% ; V, 1-6% 


Highest Percentages 
Q, 92-0% : V, 94-7% 
P, 19-3% ; T, 36-7% 
V, 8-8% ; T, 11-8% 


It will be obvious from the foregoing tables that for Examiners 
Q, R, and V, the word " literate has a widely different connota- 
tion from that which it has for Examiners P and W, and that 
th^e again differ no less widely from Examiner T. ,, 

On the whole number of awards, the percentage of ” Noes 
was 7 ; of “ Doubtfuls,” 11-9, and of “ Yeses,” 81.1. 

11®- Thus, talcing the average, nearly 19 per cent, of the 
verdicts of the examiners were “ No ” or " Doubtful.” In so 
far M any significance can be attached to results so discrepant 
lor the ^erent examiners, the figure supports the severity of 
juf^ment of the Government Investigators on the standard 
o < nghsh displayed at the School Certificate examination. 

to ensure greater efficiency the methods used at the examina- 
lon lave been recently changed at the suggestion of the Board 
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of Education, though not according to the method recommended 
by their Investigators (see para. 106, footnote 2, above). 

116. Only one certain conclusion seems possible from the 
foregoing figures, namely, that at the School Certificate stage the 
term “literacy” has no meaning sufficiently clear and well' 
recognised for it to be used effectively in judging the scripts of 
the candidates. 

Re-marking for Literacy 

117. It will be remembered (see paras. 36, 44 and 96-105 above) 
that after an interval of five months each examiner re-marked 
120 essays out of the GOO (the same for all examiners). The 
general results of the re-marking have been analysed separately 
but it seems more convenient to deal, in this place, with the 
comparatively simple question of the re-marldng for Literacy, 
which involves no complicated mathematical analysis. 

118. Table XXV below shows the number of changes between 
the first and second marldngs and their nature. 


TABLE XXV 

Chakoes betwees' rmsT akd secosb mabkinob fob Litebaoy 


JIarking 

1st 2nd 

Examiners 

P 

Q 

R 

S T U 

V w 

P 

Q 

R 

S T U V 

W 






Essay A 




Essay A1 



Yes 

Yes 

11 

17 

17 

1C 6 10 

19 13 

13 

18 

16 

16 3 11 19 

13 

Agree tnent 

I 

t 

4 

- 

- 

-51 

- “ 

- 

- 

“ 

1 _ _ _ 



[No 

No 

1 

1 

— 

1 1 - 

- 3 

1 

— 

— 


1 


r Yes 

7 

1 

1 


- - 1 

— _ ' 

_ 

1 

3 

_ - - « 

1 

Change of 

1 r 

Yes 

O 

1 

O 

2 7 - 

- I 

1 


1 

2 10 2 1 

1 

1 unit 1 

1 No 

7 


— 

1 

- 1 1 

- 1 


1 

— 

1 4 3 - 

1 


1 J 

No 

1 — 

- 

- 

- - - 

- - 



- 

_ _ 1 - 

— 

Chanfro of 

f No 

Yes 

1 

- 

- 

1 1 - 

1 2 

1 

- 

- 

- 3 2 - 

1 

2 units 

[Yes 

No 

I - 

- 

— 

- ~ 1 


“■ 



_ _ 1 - 

_ 






Essay B 




Essay B1 


1 

rYcs 

Yes 

11 

17 

19 

17 7 13 

17 16 

12 

19 

20 

19 11 16 20 

17 

Agreement 1 

? 

1 No 

7 

No 

4 

1 

1 

: 

12- 
- - 1 

__ O 

1 

- 

- 

1 - - - 

2 


Yes 

7 

1 



— ~ — 

— — 

3 

- 

- 

„ _ _ , 

- 

Change of 

? 

Yes 

2 

2 

1 

2 9 6 

2 2 


- 

- 

-81- 

1 

1 unit 

No 

7 

— 

— 

— 

-I - 

— 1 



— 




I 

No 

- 

- 

- 

— — — 

— — 

2 



_ _ - 


Change of ( 

No 

Yes 

-- 

- 

- 

- 1 - 

1 - 

- 

1 

- 

- _ 3 - 

- 

2 units 1 

Yes 

No 

I 
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119. Table XXVI below gives a summary of the changes, 
analysed according to essay-subjects. 


TABI^ XXVI 

StTMMABY of NUMBEB of OHAKGE3 IK Re-MAEKING FOE LiXEBAOY 


^ atur© of cliango 

Yes — Doubtful 
Doubtful — ^Yes 
No — Doubtful 

Doubtful— No 
Yes— No 
No — Yes 

Totals 


Essay-subjects and 
number of changes 
A A1 , B B1 C 


Total 


Cl 


3 
15 

4 
0 
1 
6 

29 


6 

18 

12 

3 

1 

7 

46 


1 

26 

2 

0 

1 

2 

32 


3 

12 

1 

2 

0 

4 

22 


1 

8 

2 

2 

2 

2 

17 


1 

11 

1 

0 

0 

0 

13 


14 

90 

22 

7 

5 

21 

169 


WCTe ^ examiners and 120 essays ther 

® on Literacy and that at the re 
nearlv f ®^’3amers changed their minds in 159 cases, or, a 
I 20 D ^u ^ one case out of six. 
considernblir iif tbe number of changes varie 

Cl to 'S»»y-subjeoto-irom 13 tor essoy-mbjec 
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TABIJ3 xxra 

CosiTAnrsoN or PEncEXTAors or tite oirrEitENT awards for LrrEiuor 

ALLOTTED AT THE FIRST AKD SECOXD SIARJONGS BY THE DIFrEREOT 

EXA^^^'ERS 


Exatninor 



P 


Q 

R 

S 


1st 2nd 

let 

2nd 

1st 2nd 

1st 2nd 

Percentage of 

Mkg. Mkg. 

Mkg, 

. .Mkg, 

. 3Ikg. Mlcg. 

jMkg. Mkg. 

“ Yeses ” 

73-5 75-0 

02-0 

95-8 

01 -5 9G-7 

87-8 94-2 

" Doubttula •’ 

19-3 18-3 

4-8 

2-5 

7-0 2-5 

0-3 3-3 

"Noes ” 

7-2 C-7 

3-2 

1-7 

1-5 0-8 

6-8 2-5 



Examiner 




T 

U 

V 

W ! 

Averages 


1st 2nd 1st 

2nd 

Ist 2nd 1st 2nd 

1st 2nd 

Percentage of 
“ Yesea " 

>Ikg. Jfkg. Mlig. Mkg. Mkg. l^ncg. Mkg. 3Ikg. 

Mlcg.Mkg. 

61-6 80-7 83-8 

900 

94-7 

100 73-8 8G-7 

81-1 90-64 

Doubtfula " 

36-7 12-5 7-3 

60 

3-8 

0 0-8 6-8 

11-9 C-2 

•' Noes ’• 

11-8 0-8 8-8 

6-0 

1-6 

0 10-3 7-6 

I 7-0 3-1 


122. Every examiner raised the percentage of his “ Yeses ” at 
the second marking, though for Examiner P the change is not 
significant. Examiner V, the most lenient on the first marking, 
boldly declined to designate a single script as illiterate at the 
second. 

The greatest change is in the figures of Examiner T who raised 
his percentage of “ Yeses ” from 51-5 to 86*7, and diminished 
the percentage of “ Doubtfuls ” from 3G-7 to 12‘5, and of “ JToes ” 
from 11'8 to 0-8. He had obvionsty no steady idea of what 
connotation should be attached to the term Literacy in marking 
School Certificate examination scripts. 


Typical examples of Essays regarded by the examiners as 
“ illiterate ” or of doubtful literacy 

123. Examples of some of the essays in regard to which there 
were marked differences in this matter between the examiners 
win show the difficulties with which they had to contend. 

124. The following table shows the number of candidates who 
respectively received one, two, three, etc., “ Noes ” in the marking 
of each essay-subject. 

TABLE xxtan 


Essay-BUbject 

A 

A1 

B 

B1 

C 

Cl 


INo 

22 

20 

16 

11 

10 

11 


Number of 
2 Kocs 8 Noes 

6 4 

10 3 

4 3 

3 1 

6 1 

4 4 


Candidates who received 


4 Noes 
4 


5 Noes 6 Noca 

3 

3 

1 1 

2 1 

2 

1 1 


7 Boca 
1 
1 


8 XOM 
1 


ToUl. 

40 

38 

24 

20 

19 

21 


1 
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The improvement from essay-subject A to essay-subjects B 
to Cl, may be due in part to progress of the pupils during the 
course of the investigation. Table III, showing the mean marks for 
the essays in all categories, gives evidence of some improvement 
dining the course of the investigation, but of nothing so marked 
as the foregoing table seems to indicate. 

125. No pupil had aU his essays marked “ No ” for literacy by 
all the examiners, but the weakest of all for literacy was No. 43. 
The following is a summary of his awards : — 


Essay-subject No. of “ Yeses » No. of “ Doubtfuls ” No. of “Noes 


A 

A1 

B 

B1 2 

G 1 

Cl 2 

Totals 6 


8 

2 6 

1 5 

7 
6 

4 39 


Out of the 48 verdicts given by the eight examiners on his 
six essays, there were 39 “ Noes ” and only 5 “ Yeses.” Samples 
of his work will therefore give some idea of what “ illiteracy 
means to School Certificate examiners who are in fairly close 
agreement in regard to particular scripts. 

In the following passages the mistakes in the original are 
reproduced.^ The essay on subject A1 by No. 43, the only one 
out of six hundred which all the eight examiners regarded as 
ilhterate, is reproduced in extenso below. 


No. 43. 

Games in Schoois. A1 

Games should be regarded as a pleasure not a duty, even in schools. 
Q. have always been a pleasure not another way to do work, 

bmularly games should not be regarded as making a living they also 
^ot be^ taken too seriously. 

^^e Australians are very good at games but they take it much too 
^ I'bey start loosing a game they accuse you of playing a 

aay that making games a duty improves dioiplins- 
f ^ reached games cease to be games they become a 

of work. At this point quite a lot of pleasure is lost. If people 
anything it cannot be so good as the work of a 
pe on who jogs along steadily. Similarly when dicipline in a game 

noted that some mistakes, e.g„ “lot” for “lost”, are due to mere 
mad^the*Srt”°*' ’Snorance, but no comctions of such mistakes have been 
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is tiglitond up. interest is lot. Compare for example a Test match 
at cricket and a school match. ' In a Test match dicipline is not actually 
tighter but the poplo just treat it as a game. It should be like this in 
a school match sometimes in a school match you find a bulljdng type 
of captain who wants to bo top dog overj-time I do not say this happens 
ove^ime hut this tj'po of things spoils games. 

Since a boy will never start at the top of a ladder ho will haw to 
take orders so ho might just as \vell start on the plajong field. Because 
when he starts out in the world, it will come as a great shock to the 
boy to take orders. Ho has learnt to take orders in school a little 
but not to the extent that he will ba\'e to later on. 

Games improve the mind beyond doubt it makes you tliink. If 
you are not careful you will make a boy hate games and they will 
become a boro to liim this will happen I think if games are made a 
duty. 

It \riU not improve a boj-s health it this happens. A person will 
engage a hoy only if ho has good health I think this comes before the 
point of having a school cirtificate. 

Beyond doubt games should be regarded as a pleasure. 

126. We quote the first tliirteen and the last nine lines of 43’s 
essay on subject C, which seven out of the eight examiners 
regarded as illiterate : — 

Speech Day 

This is the most memorial and auspisions ocention of the year. It 
is a rendezvous for the boys at school, the old bo3's who have met the 
difllcultios of the world and the boys leaxdng sohool to go and fend 
for themselves. It is the one ocention when the Hoad-master speaks 
to the boys when various goveners and tlio boys parents are present 
among the assembly. 

The evening opens iivith the song or lij-mn Jerusalem after wliich 
the chair man adresses the assembley. Then comes the Headmasters 
address to wliioh everj' parent looks forward to. ho speaks of the 
comming events of anj’ specially outstanding persons of the school 
and of any school victories in the athletic side. 

It is also had for the health sitting in a crowded haU for some of the 
people have to stand. The boys should have the choice of going to the 
speech day if they wanted to or not going. If this was tried over 
h^ the school would stop awaj- and those that did go would chieflj- 
be the prise-winners and those who wanted to see what land of an 
ordeal it was. , , , , . , , 

Speech daj- should only bo for the parents and the hoi’s who ^vlshed 

to go. 

127. Here are two passages from Ho. 43’s essay on subject 
Cl (for which he had only six “ Noes ” and two “ Yeses ”). 

As I entered the hall I was struck with the dreary ness of it since it 
was largo and gloomy. Around the walls were the remains of previoiw 
festvities and dances. These were in the form of paper-ohaip and 
coloured papers. In the comers were parts of the armie’s equipment 
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which was uncussesfully hid beneath large tarpaulins. The platefonn 
upon which visitors and important people stood was gaily coloured 
while a cover of satin and velvet hid the stains and marks on the old 
armj' table underneath. Row upon row of empty chairs were also 
seen in the morning but in the evening all these were full of murmuring 
people. 


This year speach day was more interesting than usual since a new 
school is being built also a swimming bath. There was much laughter 
over the swimming cup which the Headmaster gave to the school 
7 years ago. The school has never one the cup although they have 
been very near to it. Becldngham who has won the cup has a bath. 
Perhaps it [a ahp for “ if ”] we have a bath we shall win it. 


128. Finally, we quote the beginning and the end of No. 43’s 
essay on subject Bl, for which he had five “ Noes,” two “ Yeses,” 
and one “ Doubtful.” 

®^glishmen we are proud of our country, and we think 
a England is by far the best coimtry in the world in which to live. 
• with this, in the same way as you agree with people who say 

this about your country. e i- i- 

_ The governments that our people prefer are slightly different in their 
^ews, although both our Fatherlands want peace at any price.*^ With 
ur emocratio government King and Queen everone is happy- There 
prospenty in our coimtry, although we owe part of this to the manu- 
iactme of armaments. 

Engird has bred many famous men and some of these men have 
t things, .^though some people doubt whether it is 

The famous men are Scott Shakespere Masefield 
Elliot Eelson Raleigh Drake not to mention Pope and George 

aocomt my beloved French friend, I think you will 
ppreciate England a little more than you did before. There are one 
in these few pages that you cannot boast of, especially 

RnnTH-<rr« *1*® nature of the British people they are allround 

never contented because when you become 
perfectly contented you and a clam are first cosins. 

I remain. 

Your friend, 

B.B. 

clear that No. 43, though the most illiterate 
he wnnfo ? ates, has quite a respectable power of saying what 
an without any kind of ambiguity. TTis work affords 

SrtffieS’ Statement in para. 107 that no School 

■DUTiil " unable to read and write.” Indeed no 

pupil unable to read and write would be admitted to a School 


* This was written in 1937. 
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Certificate class. It -would seem that it was onty by a stretch 
of the^ imagination or of their own use of English that the 
Investigators could describe some School Certificate candidates 
ns " illiterate.” ^ * 

But the fact that our omi examiners regarded a number 
of the essays before them as illiterate affords some justification 
of the exaggeration of the Investigators. 

130. It may be interesting to quote passages from essnys in 
which the examiners were far more divided in their judgments 
upon literacy than in the case of No. 43. 

Pupils capable of writing some paragraphs of fair merit may 
flounder badly in others. It is not eas 3 ’^ to find any single adjective 
comparable -with either “ literate ” or “ illiterate,” adequate to 
describe such unequal work. Perhaps the word that we have 
chosen — “ doubtful ” — describes it most suitably ; ‘‘ uncertain ” 
might also have its advantages in describing the performance of 
a person who scores two or three bull’s eyes, one or two “outers,” 
and actually misses the target altogether at times. 

131. Por his essay on subject A, No. 49 received three “ Yeses,” 
three " Doubtfuls,” and two " Noes.” We quote three passages 
marked (a), (6), (c), which illustrate the difficulties which the 
essay presented to the examiners in arriving at a verdict : — 

(a) School life -would be very dull if no time was given up to play 
games. Some schools have more time for games than others, and 
in the end these schools make better sportsmen of the boj's and this is 
a great thing in a boy’s life. 

Some schools hove the gomes period in the morning and some in 
the afternoon, and I think the morning games are the best, because 
it is cooler and the air is much more refresliing. 

In most schools there are organised games with other schools, but 
only in certain games ; e-very school has some kind of a gj-mnasium, 
in hero not onl3’- do exercises take place for impro-ving the bodj' but also 

^ Hie average marks awarded to No. 43 for Sense and General Impression 
were as follo^vs : — 

Essay-subject A A1 B B1 C Cl 

Sense ' 4-1 4-0 4-76 6-1 : 4-0 5-4 

General Impression 3-4 3-4 4-5 4-S 3-6 6-0 

It is noteworthy that his average marks for Sense are consistentlj- higher 
than tlioso for General Impression. Tliero is a good deal of variety in the 
individual judgments. Out of the 48 marks for Sense he gets seven 2’s and five 7’s 
and one 8, and out of the 48 marks for Genera! Impression he gets ten 2’s and onlj- 
one 7. It may certainly bo asked whether his marks for Sense were not affooted 
by'his defioionoies in otlier categories, although the script was marked for Sense 
before the other categories. 

. * According to Miss Vera Brittain, one Oxford examiner described the examina- 
tion papers of that distinguished young -writer, Winifred Holtby, as “quite 
iUitemte’’ {The Testament of Friendship, 1940, p. 109). There is obwualy a 
“ sliding scale " in the current use of the word. 
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games, such as hand ball. In these organised games it would be much 
more interesting if there was some land of a league formed. 

(6) All kinds of sports should be encouraged, even if the school d^s 
not permit it, for instance some schools play rugby, and only rugby 
can be played on the sports field, why not put a soccer pitch in place 
of one of the rugby ones. 

(c) These games should be encouraged much more than are ; not 
only would it make the boys good sportsmen, but also make them 
stronger and fitter than are today. 

132. No. 55, for her essay on subject Cl, was awarded four 
“ Yeses,” three “ Noes,” and one “ Doubtful.” We quote from 
it two passages marked (a) and (b ) : — 

(а) We were aU in our seats long before all the important people 
were seated on the platform. The platform really looked lovely, it 
being decorated with ferns and flowers. "ViTien at last people did 

on the platform, the noise wliich had been going on in the hall ceasM 
instantly. It was rather a loud noise and the parents said afterwar^ 
that it was really surprising that such a noise could suddenly be subdued 
to silence in a second. 

(б) The Headmistress’s report come next through which we had to 

do the usual amount of clapping. I am afraid that I caimot wnte down 
all what she said as it would take to long. , 

Next various other speeches were made by different people on the 
platform, all of which were loudly clapped. 

The actual giving of the prizes came next and the long line of 
slowly received their prizes, this was so as each girl was loudly clapped, 
especially the girls who had more than one prize. 

Passage (a) explains the “ Yeses,” passage (b) the “ Noes. 



CHAPTER VI.— EXAiWLES OF ESSAYS SELECTED OH 
THE BASIS OF THE JIARKS ALLOTTED TO THEM BY 
THE EXAj\nHEES» 

(A) Examples of the Best Essays 

133. In tlie chapter on Literacy vre have given examples of 
essays regarded by the examiners as the poorest. We now 
quote examples of the work which they regarded as the best 
in the categories of Sense and General Impression. The examples 
have been taken mainly from those in the “representative 
selection ” made by our statisticians for Tables H (1) to H (6), 
pp. 24-29 above. The marks for Sense and General Impression 
will precede each essay which we quote, in frill or in part. The 
marks for the other categories are given in the tables referred to 
above. 

134. For the undirected subject A (Games) we quote two essays, 
Nos. 61 and 81, which (by pine chance) express very different 
opinions. Both are by girls. 

The marks are as follows : — 



Examiner F 

Q 

R> 

S 

T 

U 

V 

W Average 

No. 01 ^ 

j Sense 12 

11 

12 

13 

12 

12 

12 

12 

12 

L General Impression 10 

11 

11 

12 

12 

12 

12 

11 

11-4 

No. 81 ^ 

f Sense 11 

12 

13 

7 

12 

10 

10 

13 

11 

[ General Impression 12 

12 

12 

S 

12 

10 

10 

12 

11 


The awards of the different examiners are closely concordant 
for the two essays ; and but for the low marks given for the 
second essay by Examiner S, the averages for the two essays 
woidd have been, rouglily speaking, only half a unit apart. 

We print both essays in exlenso. 

A^o. 61. 

Essav a 

Games, to the average school girl or boy, form a recreation from the 
ordinarj' school work. This is not always so when the child has just 
begun school, because if asked which subject he prefers he will generally 

* As in previous examples, mistakes in the originals have been reproduced. 
Proper names which were, or appeared to bo, the names of real persons have been 
replaced by fictitious names or initials, in some cases enclosed in brackets. 
Addresses at the liead of the letters have been treated in the same way. 
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choose the physical training period. In the case of small children this 
insists of simple singing games such as “ Ring a ring of roses.” 
However as the child grows ho begins to he especially interested in a 
certain academic subject and no longer looks upon games as the most 
mterestmg lesson, although he has now graduated to hockey or football 
on the games field. 

All cl^dren, unless they are ill, enjoy the games period ; but it is 
often dfficult for the school-master to know how much “ games ” 
® be allowed. A school -master of one big school in England made 
giving half his school twice as many games lessons 
as e other half and he found that too many games were conducive 
to bad examination results. 

How then, should the games periods be allotted 7 Should one whole 
a emocm be given each week or should physical training lessons be 
scattered oyer the whole week 7 I think that the latter course is the 
nios semible. There is no greater incentive to work than the prospect 
ot ^endmg forty happy minutes on the games field after the more 
finished. Therefore perhaps games alwa 3 re ought to 
- , . ® afternoon’s work. However, consider the case of a boy or 

Tf ^ sc ool team which has to practice after ordinary school hours. 

. ^g’dar games lesson is the last lesson of the afternoon, they go 
out to practice with the team feeling tired. 

f . , ® vious answer is to have the games lesson in the last period 
i-u oh gives an answer to all our problems. It provides 

their vrork and then sends home the boy or girl ready for 

the f afternoon which is spent industriously because 

the rert o/ the^^*” enjoyment and will work bard for 

^estion settled with regard to games, but another more 
eames in arises. IVe have decided on the correct place for 

lesson nrn ^ ^nt how manj' times a week should this 

neonle i fdgh should games rank in the training of young 

it was fnnn/i + 1 ? o^ample of the school master I have mentioned earlier 
Manv soWTo games cause a falling off in other subjecte. 

quite a Knt;=f three games lessons a week and this seems to bo 
punils and number, giving enough recreation to satisfy the 

subjects. ^ removing their interest too much from ordinary 

to the mental ability ; for 
ne^ed S quickness of thought which are also 

self control and^fd'*^^/°l^' ® young boy or girl training m 

fn good stead in nf+ ^ spirit of fair play which stands any person 

helps even the nio ^ well-known that a healthy body 

keeping fit. The games provides an opportunity for 

voung^onle and p ™P®*'*f'*on which games provide is also good for 
to rlp^rt thek nnn^ defeat as well as success and 

food before thov pourse there are people who need 

controversv for^hn o Physical jerks and this has raised a storm of 
of tho nation In °'^™™®nt are complaining of the physical fitness 
can ha\-o no place ^ ^‘dte true that physical jerks 

for this is the on« n children become well-nourished and happyt 

really enjov in the life of a child before it can 

important part* in tlm before physical, training con take an 

P nr part m tho daily school-life of every' child. 
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Essay A 

If you told a little boy of about four 5'ears of age that instead of playing 
with his toy train he is to run races in the garden with his little sister, 
he would bo puzzled and resentful. In the same way do some girls 
resent being forced to play games when they would rather be taking 
a quite walk or sitting under the trees in the school grounds, chatting 
In spite of everything that is said in favour of compulsory organised 
games I will always maintain that they should not be compulsory. 
In the early years of school life they serve their purpose. They draw 
a form together and form a team spirit, and the younger girls enjoy 
them. I am speaking of rounders now when I say that having played 
this game for five successive summers I am utterly bored with it, 
and I think I am not alone when I express this opinion. 

In the Upper IVth and Vth forms we have our games period in the 
last three quarters of an hour before we go home. In the summer 
this means that after sitting cooped up in school all da3’^ we are set free, 
as the staff fondlj' imagine, to enjoy ourselves. It is very hot, fielding 
in the sun and running, it is worse still. The sun beats down, we 
get hotter and sticlder, and look longingly towards the cool, shady 
seats imder the trees. No, we cannot go and sit down ; we must keep 
up this farce of enjoying ourselves. We must pretend to be tlrrilled 
because someone has scored a rounder. 

At the end of the game we are hot, tired and slightly irritable. Now, 
we have either to walk, 03'cle or ride in a stufiy bus, home. Are we 
then fit to settle down to two or tliree hour’s homework ? In the 
winter it is nearly ns bad. We rush mndty up and down a netball 
court and since it it cold wo get a tight, choky feeling in our throats. 

It starts to rain a little, but we must keep on playing, and must not 
grumble because wo want to be sports. IVhat a farce it all is ! 

How far is this compulsory sport developing the so-called “ Sporting 
Instinct ” ? Have 3'ou ever seen the crestfallen look of a not-veiy-good 
goal keeper when she has just let tlwough a pBrfectl3^ easy shot, nor the 
ill-concealed black looks of the rest of the team. They are not 
ill-natured girls — far from it, but they are disappointed. The goal- 
keeper should play in another place, 3mu 503'' ? It is not so eas3', 
because she just has to pln3f where she is put,’ and cannot argue about it. 

“ Someone has got to play goal keeper,” the games-coptain protests. 

It is a very cold place to play and therefore unpopular. Is that any 
reason wh3’’ a girl who has not had mucli practice as goal-keeper should 
be subjected to that humiliation 7 Apparentl3- “ sport ” covers a 
multitude of sins. 

The old idea that all children should be made to learn the piano, 
however much they hate practising is d3dng out. Then isn’t it time 
that compulsor3^ games died a natural death ? At present I am sitting 
in the formroom, writing tliis by the windows which are right down. 

It is almost like being out of doors, because it is so cool and [? all 
omitted b3’' inadvertence] I can hear is the birds in the trees. I am 
much happier to be sitting hero writing tius essa3' than I would bo if 
I were outside plavdng rounders or tennis. I am interested hero. 
Outside I should be bored. . . . 

Of course, there are some girls in this form who love games. Lot 
them pla\' then. If wo others prefore not to pla3' why ma3' we not 
sit out rmdor the lovelv’ trees and rend or talk 7 Wo should bo in the 
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open nir and if throe quarter's of an hour’s ruafung about la 
make tlio girls ■a-ho aro playing games into healthier women tna 
shall over bo, then I am wilHng to take back all have said and i 
try to amosso some enthusiasm for organised games ; but I , 

sure this will never bo necossarj'. I am sure their games lossim wii 
profit them more than my quite rest will profit mo. I think they wo 
slightly onvj' mo and quite soon want to follow my example. 

135. Subject Al, the "directed” essay on games in tvhich 
pupils were asked to state pros and cons in the form of a speec 
to a Debating Society (see para. 18 above) was found much harder 
than subject A. The marks of No. 85 are as follows : — 

Examiner P Q R S T U V W Average 

I Sense 11 13 12 7 4 9 11 12 9-a 

No. 85 ] General Im- 

' pression 11 13 12 .7 .5 10 11 H „ 

Both S and T mark the essay below the level of “ competency) 
though the rest regard it as decidedly above it. 

No. 85. 

Essay Al 


School Gasies 

jMt. Chairman, ladies, the subject under debate today 
games should bo regarded as a duty or a pleasure. No doubt m 
minds of most of you present hero there is no question as to the 
to this question. However, there are usually two sides to every ques i 
so let us consider them carefully. 

Most people nowadaj's enjoy games. There must be some 
for this and it is ray opinion that it is the excitement of the game t 
gives them so much pleasure. It cannot bo said with absolute 
that games are a source of relaxation from hard work. Games a 
harder on the physical strength of the player than an ordinary . 
work and in some games an alert brain is essential for quick 
which may alter the course of the whole game in on instant. There o 
gamra do make for a general alertness of the mind which is of considers 
use in other spheres than that of sport. Games aro not absolutely 
necessary for the development of the body but thej’’ are the 
and by far the most pleasure method for children. Games are dou y 
pleasant after sitting doubled up at a desk for the most part of the day* 
It is a relief to stretch stiff muscles and to free in a fast game of tennis, 
cricket or hockey the energy which cannot be used up in studjL 
Games may also be regarded by some people as a duty more than 
pleas^. They probably think that it is right for them to play g®™®, 
m order to carry out their daily work as well as possible. This does n 
mean, however, that because it is a duty they cannot obtain any 
pleasure from it. It is impossible for any healthy person to dislike 
g^es absolutely. You will notice that I said any healthy person. 

e player is very delicate or cannot stand a fast game it is extreme y 
unwise for him or her to try to do so. This would be carrying the 
oi duty too far at the further detriment of the person’s health. 
. i violent ways of development should be sort by these 

o unate people to whom games mean nothing but misery. 
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Therefore, in conclusion, it is my opinion that games can bo both a 
duty and a pleasure and should be regarded ns such by those who wish 
to ranko their waj’* in the world. 


136. For the undirected subject B, “ In Praise of England,” 
the two pupils in the “ representative selection ” marked highest 
were N'os. 11 and 6S, whose marks are as follows : — 



Examiner P 

Q 

R 

S 

T 

U 

V 

W 

Average 

Ho. 11 , 

i 

r Sense 9 

11 

10 

10 

10 

10 

9 

13 

10-25 

General Im- 9 
[ pression 

12 

10 

11 

10 

10 

9 

13 

10-5 

No. GS 1 

' Sense 1 1 

10 

11 

9 

12 

12 

11 

12 

11 

General Im- 1 1 
pression 

12 

11 

9 

12 

12 

11 

12 

11-2 

As we quote other work of No. 68 we shall only quote 
essay of No. 11. 

here the 


m 11. 

Essay B 

_ England is almost the only countrj’- in the world that at the present 
time has peace witlun its shores. In Europe Spain is divided in thought 
and is in the tivroes of Ciwl war — Italy and Germany are proud countries 
that Imve been cowed by their dictators who allow no freedom of thought 
or speech in their respecti^-e cormtries, while in England e^ij-ono is 
free and ha\-e not the fear of imprisonment hanging over their heads. 
Franco is fighting for its rights for the workers while Albania disappro\'e3 
of their king. England’s loyalty to its king was shown in last week’s 
celebrations of the coronation. Our peace and goodwill was clearly 
vTsible in the affection everyone showed to their Jlojesties on. Coronation 
Day. 

England, although di\'ided in opinions in the Government has a 
competent council of men to deal with the affairs of the colmt^ 3 ^ 
The House of Commons xmderstand the needs of the people because 
they are part of them. It is the Government of the People, by the 
people, for the people wliich makes England the peaceful countrj' it is. 

The people of England are loyal to their countij' winch helps a Jot for 
the ruling of this island. The British Amij' ore faitliful to their king 
and thej' protect and guard “ tins earth, this realm, tliis England.” 
The na\w also guard English shores and it is tlirough them we have 
establish^ a high position in the world. As well as being faithful 
to its king the inhabitants of England are faithful to God — as in the 
song of England ” we liighly dedicate, O Lord, to thee.” Also that we 
“ . . . maj- be renowned tluwugh all recorded ages for Clwistian service 
and true cljivahy.” 

The countrj-side of England is very beautiful for almost ewry tj-pe 
of flora is foiind here. In South-East Kent rolling green downs and 
beautiful woods enhance the beautj- of the high gleaming white clife 
and the treacherous blue-green sea that sparkles and flashes as the sun 
catches it. On the downs amidst the beech and ash trees one may 
hear in Spring, the chirruping of the birds and especiallj' the beautiful 
song of the nightingale. Carried on a light breeze distant sounds 

o 
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admonishing Hs^lonHi fn° Tho plaintive sound of n sheep 

the hens and raucous nboufc-tho anxious clucking of 

sheepdog and tho fninf cockerel — tho low, deep bark of a 

be milked. In the orinnc^f^”*^ ^ the farmer taking tho cows back to 
see high, toworina England, tho Northwest, one may 

■while down in wdth snow still on their summits — 

imdistiirbed town or ® follow, perhaps lies a quiet 

ring — gleaming anrl nUt+l .Posfect in its sotting like a stone set in a 
ever widening ring to tho ripples caused by a fish extend in an 

Englan^f ° lake, 

bas obtained for i^olf different from that of yesterday, for it 

had not got a hundroH imo strong position in the world wliich it 
y rs ago and which I hope it \vill alwaj's possess. 

received Se^foUoT^g^^ariJ^!^ subject BI, Nos. 12 and 68 

' W Average 

[ 12 11-5 

11 11-9 

13 11-9 


No. 12 . 

Examiner 
' Sense 

General 

P 

8 

Q 

13 

R 

11 

S 

14 

T 

14 

V 

10 


Impression 

11 

13 

11 

14 

13 

11 

No. 68 . 

r Sense 

General 

11 

11 

13 

11 

12 

12 


Impression 

9 

10 

13 

11 

12 

13 

Both essays are printed in 

extenso. 




Essay B1 

Dear Henry, 2nd July 1937 

festivities which took nla^^’^ yoiw account of the annual village 
n insight into the social lifo f dirtrict a week ago. It gave me 
before. But I read with olor, ^ France which I had never had 
e very conscious patriotism*^ pleasure what you said about 

at all tunes of the year wWlT^®* “ common to aU French people, 
®ust, m turn, try or play ; and I felt that I 

f'hat more silent t. a^d perhaps, rather vague, 

K ^®r to the Englishman love-of-country which is 

^ nationthV ' ^ hifinitely stronger 

j®®^'°®ed JohnBill--!itHiX®^ is stiU, at heart, the old- 

^orer of ^®^rd of our now immortal 

of t>iA”®i.^°^*^ride, of the^vpo ^ glorious past and her ever sweet- 
«nd -r^^^O'^^shed thatched ro+t*****^ newly ploughed acres, 

not forget them-^^f*?®’ roses and cabbage-plot, 

T^® ^oglande. ^ ^^em-of the good old roast beef and beer of 
do Hot "Want to a 

d^end''xc^u^^^ matters as, for instance, 

Pohit tut^thJt®** ^dividual taste ^fryi *t® 

that your roads are fm ^ ^ c^pect you would soon 

as are immeasurably finer thdn ours. 
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All I can do to romind you of our great King, our domooracv, 
our individual lilvrty, and our pro'.perity ; theso nro somo of our 
greatest possessions, which every true Englishman is most carofullv 
preserving. I suppose it would bo quite tactless to suggest to most 
Froncli people that Kapoloon’s remark about a Nation of Shoplceopors 
vas n high compliment, but it definitely wn.s. 

The English people are tho most good-tempered on earth ; intellect- 
ually wo nro tolerant ; socially wo nro good-humoured. It is, I may 
pay, this right good Jiumom-, illuminated ns it is by reason, thot con- 
stitutes ono of tho most characteristic and noblo qualities of our race. 

All over tho globe wo find Englishmen ; mainly bocauso in tho 
homo country we have tho enormous ndvantago of being rvitlnn a fow 
miles of tho sea — compared with other coun trios — ^no matter where wo 
live. 

It is tins same nd\*antngo — tho ndvantago, so to spoalc, of having a 
choice continent all to onrsolvcs — that has spared from many of the 
ridiculous and useless quarrels, which ha\-o nlwaj-s boon so prevalent 
in Europe. 

AATicn wo have been forced “to adjust matters,” tho trraditional 
reputation of tho Englishman, for being ablo to go right through wth 
any situation, has triumphed. 

Hoping to hear mote good tilings from you soon, 

I remain. Your Friend, Joni; 

Ko. 68. 


Essay B1 


OitiUne 
Main Thomo. 
Intixiduction. 

Main Port. 


Conclusion. 


Superiority of England. 

“ All men were bom free, now man is oi-orywhero in 
chains ” — thus Rousseau ; but not ovorj’whoro. 
Tlio English stoh'dness ns opposed to hot-hoaded- 
ness. 

Characteristics of English thinking. 

Beauties of England — widely differing. 

Tho countryside. 

Tire reason for England’s happiness to-day is that 
she is free, and evorj' smallest component of it 
has his say. 


[99, Oxford Rd., 
Jliddlemoro.] 

Nov. 5th, 1937 

Dear Andrti, 

You say that most people consider their country the best in the 
world. It is onlv fair to say that they are perfectly justified in thinking 
so, but naturalfy I wholeheartedly disagree with them. I honestly 
think that, being tho happiest country' to lii-e in, England is the best 
cormtrj' in tho world. 

Rousseau, in his famous book “ Tho Social Contract,” opened with 
“ All men were bom free ; now man is everywhere in chains.” 
“ Evoryivhero ” is a sweeping generalisation, for obwously Rousseau 
had not mode a stay in England. England’s greatest gift is freedom. 
Freedom personifies' her actions, whntover sho does. Even in the 
groat War, sho stepped in to sa \'0 Belgium from going into bondage, 
which was what would probably have happened. 
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Freedom comes out in other ways. In countries ruled by a dictator 
with an iron rod, freedom has never been heard of. The citizens would 
be executed by thinking of freedom, because it is against the principles 
of a dictator. Thej’' may not speak against their rulers, either in public 
or at home. In England wo may say and tlu'nk exactly what wo like, 
and may express our views in rhetoric, ns long as wo do not create ^a 
disturbance. It may bo the some in Franco. I do not know. IVe 
may elect our government, and vote for any party' under the sun. 
Tills is impossible in dictatorship countries. 

Democracy breeds freedom, and England has the foremost democratic 
government of the world, with Franco ns a runner-up. I am convinced 
that democracy is the only method of government which will solve 
Mie world s problems. Aggressive dictators do not try to do this. 
They just create more. 

England is lucky in that she is an island. She has no frontiers to 
^ar^ like Eiiropean countries. Admittedly' it is by no ivill of her oivn 
that England is an island. If she had had frontiers to guard, her owner- 
ship mght have been changed so radically as that of the boiling and 
seething hotch-potch of the world— Europe. It is our good fortune 
t^we can, or could in the past, stay clear of the plots and counterplots 
o urope. With the advent of the aeroplane, it is natural that the 
system of frontiers has broken down, and our country can now be as 
ea« y attacked as any other, within reason. 

- be looked at from another and more material aspect, 

oif of some very beautiful and ividely varied coimtry’side. With 

® clashing marvels of the world, the English countryside has a 
and harmonious effect on a coimtry-lover. I suppose every 
country feels the same about its country'side, but I doubt if it can oom- 
with her gaunt rocks and Scottish lakes, her 
^ golden fields of com, waving in the cool 

, ® ^ Si^olk nightfall. Glorious indeed is the pageant of colour 

^ paraded before the Englisliman’s eyes, and 
it- I sometimes doSbt if he is. 

® ® happiness depends upon a large number of things, but all 

oa freedom, and the ability to enjoy it. If the people 
wonl^ ^ ^ were suddenly and unexpectedly freed, they 

to ® out of water that they longed 

It nr, 1 their dictator, with his old familar oppression, again- 

the kno-nrir.!^ aU being free, if you have not the ability to enjoy it, aud 

knowledcrp 8® how to use it. But England has that ability and that 

knowledge, and uses them very sensibly 

Yours sincerely, 

Abthub. 

subject C the best candidates selected 
(6) were 41 and 95, whose marks are as follows ■- 


No. 41 


No. 95 


ExamiTier 

Sense 

General 

P 

Q 

B 

S 

T 

U 

V 

W 

Average 

11 

12 

11 

9 

10 

11 

9 

11 

10-5 

Impression 

Sense 

General 

11 

12 

10 

10 

10 

10 

9 

12 

10-5 

11 

11 

9 

8 

11 

13 

11 

13 

10-9 

Impression 

11 

11 

9 

8 

11 

11 

10 

12 

10-4 
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No. 41. 


Essay G 


A ScHooii Speech Day 

For weeks beforehand, there has been excited chattering amongst the 
pupils, IVliat is it all about ? * you may ask. You will soon recei\e 
an answer. “ Don’t you know ? Speech day in a fortm'ght’s time.” 
Then you realise that the lusty voices you hear every day floating 
from the Hall, must be the various forms rehearsing the songs which 
are to delight their parents ; that the speech day is the reason for the 
conversation often turning to white frocks and coveted hooks; and 
that it is because of this great day that the Head Girl is busy preparing 
her speech. The list of prize-winners is read out. The lucky girls 
reap the reward of hard working by being allowed to chose a book for 
a prize. The singing mistress rehearses the songs and brings them to 
a liigh standard ; and the girls are given their positions for the great 
day. Then, at last that day arrives. 

In the morning it is often bright. All the scholars attend the final 
rehearsal and put their hearts into bringing the songs to perfection. 
After rehearsing for most of the morning everyone returns home to 
spend the afternoon there. Then comes the evening. All preparations 
are begun and just as the white frocks are brought out down comes the 
rain, or else a fog. In tliick dark coats or ’neath large umbrellas the 
scholars troop to the hall for tliis day for which they have been waiting 
for so long. 

Inside the hall, there is more excited conwrsation. The parents, 
in due course, begin to assemble. They tiy", though nearly always in 
vain to find their daughters in the sea of white below them. How 
alike the girls look ! If Jean did not possess aubxnn hair Mis. [Robinson] 
would never have recognised her daughter ! Then finally the con- 
versation dies do'wn. The great occasion begins. 

Having duly welcomed the guests, the chairman begins. During the 
comee of the programme the scholars raise their voices and sing the 
songs which they have been practising for so long. Then the climax 
of the evening is reached. The “ guest of honour ” as we might caU that 
person distributes the prizes. The receivers are given due applause 
and proudls' receive their rewards. Then comes the speech. Sometimes 
it is about school and education, once it was about travel, and once 
about the past, present, and future. Whatever the subject, every one 
listens with great interest, determined to accept and use the Bd^^ce 
and criticisms given. 

After this speech, the votes of thanks are proposed and seconded and 
after the singing of the Hational Anthem, a very enjoyable evening 
breaks up. 

The school speech day that will probably linger most in my memory 
was the one held in our own school hofl a few years back. By means of 
microphone and loud speaker, the speeches were relayed from the 
audience in the Hall to another audience in the Gymnasium. This in 
itself was memorable because it had never been tried before. It was 
a novel experiment. I also remember it well because we, in the “ gjun,” 
were allowed the first glimpse of Miss Y. who was later to speak to us. 

Tills particular evening closed in a most original way. The lights 
fused and the building was plunged in darkness ! Although it was a pity 
to conclude such an occasion in tliis way, although accidentally, the 
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failure of the lights caused great excitement, and was talked about for 
a long time afterwards. 

The school speech day is always looked forward to and always 
remernbered for long afterwards. The occasion serves to bring together 
the mistresses and the parents of their pupils. Careers are discussed 
and advice, where it is needed, is given willingly. On this day too, 
old girls, some of whom may have left the school long ago, return. 
Once again they meet the staff and talk with them and ,by attending 
Speech Day they see the pupils who are following in their footsteps and 
doing what they did years before. 


No. 96. Essay C 

A School Speech Day 

Once every year, in the Autumn Term, the school is thrown into 
turmoil. The cause is Speech-day. The pupils’ feelings about Sp0ech- 
day vary with their age. The little ones are very excited and wander 
a out with an air of importance. The older ones await the day with, 
perhaps, not quite so much excitement. They enjoy showing off their 
sc 001 to visitors but they have an eye to the time given up for 
Speech-day as well. 

Eot weeks beforehand the pupils who take music are rehearsing songs 
and hymns to be sung on the day. People who take art are preparing 
esi^ns and pictures to be shown on the day, and the needlewomen are 
ma g cl(rthes and other useful things which will be shown in th® 
Sci^ce Room. But during the last week everything is 
numea up. Guls who are in the Chair are hauled from their lessons 
■j.® i^t-minute rehearsals. Drawings are himg in the Art Boom. 

minide glances are taken at needlework to make sure that there 
Tnniro° til® ®iid the whole school meets in the hall to 

® that everyone knows just what she has to do and where and 
wnen she has to do it. 

meanwlule another side of the preparations has been taking 
comm,-c=- out to parents. People have been 

eiven ®®rve tea in the Dining Room, and some forms have 

Thp<jB gymnastics or games in order to carry chairs to the hall, 

is sumn'sB.^ -f ^ g®^®>’ally but on the last morning nobody 

her'^^piV the floor in her form -room because 

amontr tVin taken. Speech-day is a very important event 

everv^chaiV^' therefore every inch of space in the hall, and 

wWt^dre^! this day. Every girl rakes out her 

laS Spe7ch-dl!^''n stuffed at the back of bL wardrobe since 

or whether rVir’ nd tnes it on to see if it can possibly be lengthened 
brown shoes ^ When she has decid^ 

order to make siue^that'+L^^**' ^^Sht stocldngs are inspected m 

brushing and then sVin t holes, hair is given a really good 

At ^ th® great „ 

ilistresses are all wbp^- ^® school musters in the hall, 

against the wliite nf gowns, which make a sharp contrMt 

next. At first thev ® clothes. The parents begin to arrive 

increases imtfl there is three’s but then the number 

u stream of people pouring in. Pupils whose 
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parents are coming watch carefully for them wliile the parents scan the 
lines of "pupils for their daughters’ faces. Then the more important 
visitors go to their seats on the platform. These are the Head-mistress, 
the Chairman, the person who is to present the prizes and members of 
the Education Committee. Then the Chairman announces the flrst 
song, the choir clear their tliroats and Speech-day has begun. 

The afternoon passes. There are speeches and songs, songs and 
speeches. Then the person who is to give the prizes rises and prize- 
winners get into order. As they go up to recoh'e their prizes the rest 
of the school claps and tries to look as important ns the prize-winners. 
They merely succeed in looldng as if they could bax-e won prizes if they 
had tried, ^^^len the prizes have been received the house-captains and 
form-captains go up to receive the cups and trophies which their house 
or form has won. Cheering never censes here. Then the lady or 
gentleman who has given the prizes makes a speech. Those are 
generally very interesting. But perhaps the biggest cheer is for the 
Chairman when he amiounces that we may have an extra holiday. 

Now at last Speech-day is over. The next day it is talked about 
for a little and then everything falls into its usual routine until the 
’ next year. 

139. For the directed subject Cl, the marks of Nos. 25 and 
68 were as follows ; — 



Examiner 

P 

Q 

R 

S 

T 

U 

V 

W 

Awrago 


r Sense 

13 

11 

11 

10 

10 

12 

8 

11 

10-75 

No. 25 . 

General 

1 Impression 

11 

10 

8 

0 

10 

10 

10 

8 

9-6 


■ Sense 

7 

14 

12 

12 

12 

12 

12 

12 

ll-G 

No. 68 , 

General 

Impression 

8 

14 

11 

12 

12 

12 

12 

12 

11-6 


Although the average mark in each case is distinctly above the 
median of our scale (S), No. 26 has received three 8’s from 
different examiners, and No. 68 has received a 7 and an 8 from 
the same examiner. In the case of No. 68 the opinion of Examiner 
differs strikingly from that of liis colleagues, whose concordance 
exceptional. 


No. 25. 


Essav Cl 

[11, Derby Road, 

Nortlunoro.] 
July 8th. 


Dear Jean, 

I was verj' sorry that you were ill, and xmahle to attend the speech- 
day yesterday. I am just siting to tell you all about it, as I expect 
you would like to Imow. 

The Hall was crowded, as usual, with parents and friends, some who 
had probably come for the first time, others who had been for four 
perhaps five years. But, from the various comments I heard, I think 
that everyone enjoyed the afternoon. 
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^ The afternoon before as you know wo hold a full rehearsal, and every 
girl knew her place beforehand. At a given signal there was silence in 
the stone hall, and we marched into ovu" places, the organ playing, and the 
mistresses in their gowns. A short time after we had been seated, 
the platform party came in, the Canon as usual taking the chair, and the 
headm^ress telling the others whore to sit. The lady who was giving 
the prfees sat to the right of the Canon, and the headmistress to her 
nght, just the same as it has been always. At this moment we were 
all stmding ^parents and friends sat with the platform party, but we 
remamed landing and sang the school song. I think we sang it quite 
■well for Miss 2^., looked, pleased. 


The Canon then rose and gave the chairman’s address, this was not 
too long, and he then annoxmced that V the school Choir would sing n 
thrro part song.”^ Tlie choir rose at the signal, and Jean, after all the 
pmeticmg of getting up aU to-gether we did it. That was a good start ! 

e went off well, even the poor seconds were heard occasionally 
too. UTim we sat, the Canon annoimced that “ the head mistress will 
now give her report.” Mfes Y. rose and thanked Lady A. for kindly 
con^g and pving the prizes, and then went on to give the usual account 
m tne school work, and new building, and efforts to gain enough money 
m nave a swmumng pool. This caused a good deal of laughter, and 
^ gMnes report was good, also the examination-results. 

seated herself, amid great applause from her 
RpWini -m ^ parents, the Canon rose again, and announced that the 
^ ^ ■unison. This song went off well, and I think 

S A ® hlarty clap, 

newr speech and really it was topping, I have 

sort AJJ interested in any speech given at an afternoon of this 
the wholn of t *^i°roiighly enjoyed it. You will probably see 

voup PTiintrrr, local paper this week, so I will not spoil 

^ y®® about it. 

to hn1 famous Kentish Five, and the Canon had 

was weinft-^^ to silence us. The choir then sang a song and it 

h^ore bin ^ sang quite so weU as we did the morning 

Ladv A di'il event, the distribution, of prizes and certificates. 

IooIcpH i^Ti ^ c^^rmingly, while the admiring parents and envious 

had gained seLTleS^fSrt:^ 

finished the .^®Suined their seats and the applause had 

fXStL and last song. The votes of tbante 

distributed the Pit praized the gracious way Lady A. had 

^teftWs the^ ® Pl®«®“®t word to everyone. ^ 

sat in the front row “teiw-al. The platform party came 

pulled across pnri ^ audience and the curtains of the stage were 

ATyorw the play to begin, 

sketch of two cirls were two plays — a Latin one and a 

play, of couise^o.nrnf^^ ^ School for Scandal.” First came the Latin 
was going on to the the acting had to convey all that 

they^actfd ^ ®®^ else^hought 

The other nlav ■ni.o " ,• ® ‘mstumes was very clever too. 

in the house of Sfr the fiSfc. It was a scene 

d Lady Teasle. They were having a quarrel 
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and this was noted very well. In parts they made evorj' ono roar with 
laughter. Tho two dresses were exquisite. Lady Teasle, had a beautiful 
pink tapestry frock on, shot with gold and blue, with laco round 
tho neck and cuffs, she carried n pretty fan. Her hair matched the 
costume too. Sir Peter’s coat attracted much attention, it was in 
purple velvet with a very charming loco cravat, and she wore breeches 
and black patent shoes with largo buckles. She also woro a wig and 
carried a black walking stick with a silver knob. Everybody liked tliis 
sketch, and gratoly praised tho producer. Tins sketch had a great 
applause and after tho curtain wont down there was a buzz of conversa- 
tion. Tho platform party then loft tho hall, but the parents were asked 
to remain seated until tho girls had marched out. 

In tho stone hall once again, there was the usual rush for hats and 
coats and another rush for tho rather small exit. 

I must close now after that rather rambling account. I am hoping 
to see you back at school soon, ns I am sure you do not want to miss 
examinations ! 

Your affectionate friend, 

[CAnoniitE.] 

No. 08. 

Essay Cl 

[D9, London Bond, 

AVestmore,] 

Nov. 12th 1937. 

Dear John, 

Being absent, you have missed an extremely interesting school 
function, tho most important function of tho year, ns oxir respected 
headmaster has once again reminded us. I am comnneed that ho reads 
tho same notes on speech day everj' year, although he expects us to 
laugh just ns heartily and listen just ns attentively. 

At about a quarter to two, tho usual mSloo of bored hoi's and over- 
excited parents arrived at the gates. Eventually the porter, resplendent 
in a new uniform with red collar and cuffs, opened the doors with a 
dramatic flomdsh. In trooped hordes of parents, as usual mostly 
mothers, all intent on getting front seats, showing a decided preference 
for those reserved for Governors and Friends, from which laudable 
intention they were politely but firmly told to refrain. 

AVith much clattering of bathchairs, and learned com'ersation, the 
master and Governors of tho AA^orshipful Baby-Linen Company entered, 
the more honoured sitting on the platform, and the rest in the seats 
allotted to them. The Master then arose, and proposed a vote of thanks 
wluch was completeh' inaudible, following the usual custom of votes of 
thanks. Amidst rather subdued clapping from boys and hj-sterical 
cheering from parents, tho Headmaster rose. He made a long speech 
about the school’s acth'ities, lasting a quarter of an hour, politely 
stressing every success, and omitting every failure. He sat down, and 
almost simultaneously, tho AA’'orsliipful Master ho rose, amidst more 
clapping. He made a long speech about the deplorable lack of observa- 
tion in the world today. The parents pretended to understand it, but 
the boys did not even reach that height. I forgot to say that before this 
there occurred tliat deplorable institution, the prize-giN-ing. 

Then, with clapping from tho parents only, and a strong under- 
current of booing, sad to relate, Mr. [AA'eston] appeared with every 
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indication of linsfo, including n WTonclicd collar. Ifc proceeded to wave 
liis arms about in tho approved condiicling manner, ninldng liis ff'co 
oven rodder than usual with (ho iimvonted enorgj’. Tho choir sang 
about half a dozen songs including of course (hat famous song about 
“ Sceptred isles,” and “ seats of Mars,” wliich turns up ovorj’ your or so. 
Another horriblo catcall was a verj’ unmusical round, appropriately 
entitled ” Busy, curiotis tlun.ty flj',” which, as far ns music and harmony 
are concerned, was nothing more than a farce. 

A French speech, with no explanation, followed, ably spoken by 
[Jones], although nobody understood it, except tho parents, who hided 
complete ignornneo under a mask of interest and mild criticism, as if 
detecting some fault in [.Jones’s] accent. 

There was a lionrtily applauded declamation on “ Superstition ” listed 
on tho programme, but ns tho doclnimcr had a very' largo mouth and 
a very small voicoj 1 had to content mjnsolf wth looking at ids mouth 
or else road my prize, which I was loath to do. idy mother aftonvarda 
informed mo that it was an excellent declamation, so I suppose it must 
have boon. 

'3^0 choir then again appeared on tho platform, each member taldng 
up his original position. How thej’ all managed it, I cannot imagine. 

they sang " Carmen ” with groat gusto, as they had tho rest of 

back them up, and lastly came tho National Anthom, 
uhioh Z.i refused to sing, on tho grounds of being unpatriotic to^ [jus 
county], Tho boy's immediately disapponrod, tho parents remaining 
behind to gossip, drink stale tea and eat raw buns. Tlio end of a 
perfect day 1 

Yours sincerely, 

AjiTHtm. 


(B) Exasiples of Essays kegabded as just “ Cojipetent ” 
remembered that the Sub-committee decided 
1.1 u mark C of our fifteen-point scale, A+ to E— > 

s ou be used to designate “ competency ” (see para. 29 above). 
1 .^^,®.^®'^jriation designed to test the possession of a “ utUisable 
s m Enghsh this would be the pass mark. 

, . best agreements ” to which our statisticians drew 

attention are the marks for General Impression for two essays 
on the subject Cl, by Nos. 34 and 70. We add here, as in other 
instances, the marks for Sense. 


Examiner p q 

No. 34{®®nse 5 g 

, >• vjeneral Impression 8 9 

No. 70 ] 7 g 

*■ General Impression 8 9 


It is by pure chance that t 
other by a boy. 


Essay-subjec(> Cl 
R S T U V 

8 8 8 8 8 

8 8 8 9 8 

8 8 7 7 8 

9 8 7 8 8 


\V Average 
8 7-6 

8 8-25 

7 7-5 

8 8-1 


one essay is 


by a girl and the 


^Tho 


name shows that Z. was a foreigner. 
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No. 34. Essay Cl 

A ScHooi. Speech Day 

As you Idow the Speech Day was yesterday. Probably you were 
pleased you missed it, thinking it would bo a bore hardng to listen 
to a lot of speeches. You were wTong then, if you did, because wo had 

jolly good time. The person who presented the prizes {Miss X.) was 
very nice and said quite a few funny tilings which made the school 
lnugh_ heartily. MTien we arrived all the mistresses were there in 
beautiful froete and wearing their black gowns. Xot many of the 
parents had arrh-ed, and we amused ourselves trj-ing to guess which 
girl belonged to which parent as they came in. It was rather fim, 
although our guesses wore probablj- quite wrong. All the lights were 
on. and the prizes were pil^ high on the table on the platform. The 
scenery was verj’ pretty — flowers and trees and bushes, like the usual 
colourful show found in a cottage garden in summer, — although it is 
now in the middle of October ! It all looked very sweet, though, and 
when the staff came on the platform to sit down, they all had beaming 
Countenances. 

There were the usual introductory speeches, intermingled with one 
or two songs simg by the Upper and Middle Schools. One was a lullaby 
" Sweet and Low,” and was received with great enthusiasm b 5 '- the 
parents and staff. 

The prizes were then given out, and Miss X. shook hands with each 
of the girls in turn, usually having a word of greeting or encouragement 
to say to each of them. [Diana], of course, tripped up on the last step 
and came floundering andstxunblingontotheplatform, but managed to 
look calm, though ruffled, as she stepped forward to receive her books ! 

I^Tien she had finished giving prizes, IMiss X. delivered a little speech. 
Thank goodness, it was not so very long, and so wo were able to 
appreciate it. She said that we must go on working hard, and that 
we should have to go on keeping the good standard of work work that 
we have, judging bj- the results of the exams, and the prizes. She 
realised, however, that we did not want a lecture, and so she gave a . 
few illustrations of various funny incidents that had occured in her life, 
c talked of one or two other prizegivings she had attended, gax-e us a 
little advice on work and play in general, and then sat down, amidst 
furious applause. One of the reasons that she was liked so much was, 

I think, that she was reasonably young and pretty, and so looked very 
different to some old proffessors that we have had. 

lYe had a few parting words from one or two of the governors and 
coimcillers, and then presented the principle people with bouquets. 
These certainly were beautiful. After sin^g the School Hymn, we 
left, all feeling very pleased with our evening. IVe did not get home 
too late, and I feel sure you would have enjoyed it, had you been there. 

No. 70. Essay Cl 

[33 Cambridge Road, 

Soutlunore.] 

9th June 1937. 

Dear Prank, 

I hope you have recovered from your unforttmate flhiess which 
prevented you from attending school on Speech Day. However, I 
now endevour to reproduce in writing what happened on that day. 
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On the previous day, wo wero informed by the llcndinastcr that 
wo should not assornblo in the Hall at tlio usual time, but that wo 
wait until wo wero stnntnoned by tho prefects. From nine o'clock 
until tho tiino came for ils to f'O dow-n t-o tho Hall, wo nrnusod oursolvM 
in numerous wajf;. Some played '* noughts and crosses,” others played 
other games, and a few worked. Then camo tho prefect. So with 
ono accord wo rushed to t ho door ; this was undoubted^' bocou-so 
wore 80 eager to listen to tho Kpccches. Or w-as it Ijocnuse wo wa^od 
to become comfortably Bottled in tho Hall. In a vor3'’ disordorh* order 
we wont down tho .staircase and into tho Hall which was all road}’ for 
our reception. Wo sat down and immcdiatelj' had to rlso again because 
tho Chairman of tho Board of Gowrnors, his wife, and other Governor 
of tho school camo in with tho Headma.stor. After this partj' had 
established itself on tho platform wo again sat down, tliis time for tho 
whole morning. 

The Headmaster began the proceedings with a summary of tho 
year’s work which definitoK' gained tho approval of the Govorr^s. 
Tho Chairman’s speech was' tho next item on tho programme. This 
speech was similar to last j'oar’s speech, which j'ou hoard, tho 
detail, tho opportunities for [Y] boys in “ tho outposts of Empire, being 
tho same. The Chairman introduced tho distributor of tho prizes, 
thus ending his speech. After tho Prize Distribution, tho distributor 
made an enjoj-ablo speech which was appreciated bj' tho wholo 
u Thanlts was proposed by ono of tho Governors and socondo 

by tho Secretary of tho old [Y-ians] Society, Cheers wero called, and 
given, for the distributor, A half holiday was proclaimed* and the 
meeting broke up ivith school over for tho day. ^ 

I hope J'ou will soon bo well enough to return to school althougn 
I expect J'OU feel differently about this, 

I remain. 

Yours truly, 

[F, H. SiHTH.] 

make some mistakes in spelling* 
(More distinguished people do the same.) But it is clear from 
the marks of the examiners for General Impression that they 
^Sard these essays as showing a “ competent ” command ol 
^ j ^without any exceptional qualities. 

VVe de not attempt here to analyse the essays further as this 
would be to import personal judgments other than those ot 
examiners into this section of the Report. 


(C) Examples of Essays in regard to which the Exaaiinebs 
dipfee widely in opinion 

142. There is some interest in consideriner a few^ specimens of 
essays in which the agreement of the examiners was worst. 

se se ec ed the difierences between the examiners in their 
marks tor Sense and General Impression vary from 4 to 8 points 
o our o-pomt scale, which would correspond numerically to 
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tljo large diffejvnces of from 26-7 to r.3-3 points on tho lOO-point 
scnio in genera! nso. ^ 

M3. The following are tho marks for Sense and General 
impression for four essays on subject A : — 


Examiners 

No. 91 , 

p 

7 

Q 

o 

U 

11 

s 

,7 

T 

0 

U 

11 

10 

IV 

S 

Range 

9 

1 tjcneml Improssion 

7 

7 

10 

r, 

B 

11 

10 

8 

G 

No. 22 

12 

5 

10 

s 

9 

13 

9 

11 

8 

\ General Impression 

12 

9 

10 

9 

8 

12 

9 

10 

4 

No. . 

n 

9 

12 

8 

7 

7 

7 

10 

5 

V General Impression 

11 

9 

12 

8 

C 

8 

7 

11 

6 

No.SO/^''''' , ^ 

\ Ucnoral Iinproiv^^ion 

7 

8 

11 

5 

9 

12 

8 

8 

7 

7 

S 

11 

.7 

8 

12 

8 

8 

7 


144. \Yc quote below the essays of Nos. 9, 45 and 80, 


No. 9. 


Essay A 


At nny school, you will nearly nhvaj-» find that tlio girl or boy who 
shines above tho rest at games, is rowred more than their follow- 
students who can do their le.osons bettor than anyone olso in tho class. 
At school matter triumphs o\-or brain. Your status is decided by your 
skill at games not by your skill at lessons and although the boy who 
wins a pile of boolai at speech day gets a good clop and is called " quite 
a good chap,” it is tho boj's who gets his colours that wins tho most 
applause from boi-s and parents. 

After hard work in tho class-room, girls and boj-s nro only too glad 
to get out on to the grass and to forget o badlj’ witton exorcise that 
has just been returned. But a fumbled catch at cricket remains in the 
memory much longer than tho bad exercise and scathing remarks of 
the master or mistress. 

In the corridor is a largo notice-board, the green baizo covered with 
papers. A crowd of girls aro round it, very eager to soo who has got 
into tho first eleven and when tho next practices aro. A french lesson 
ahould begin when tho bell rings but there is too much noise at tho 
notice board to hoar it. A lot of girls there aro weak at French and they 
auLSt pass General Schools to got tho job they want, but it becomes of 
secondaiy importance when tho games’ board is full. 

Of course, games nro much more pleasant than ordinary lessons. 
Even tbo “ rabbit ” at games admits that she onjoj’s being out first ball 
and watching tbo rest of the game much more than concentrating in a 
form -room. 

English youth is natiwallj’ wry fond of the open air and full advantage 
of tlio gomes period is taken. Take this kcencss and also the koenoss of 
tho young games master or mistress and you can see that it is keonoss 
and tho desire to do well that urges on the would-bo champion at games. 

At the kindergarten school in games lessons, tho first tWng we learn 
is that you cannot play games without dividing at tho least into two sides 
called teams and thus from tho beginning, team-spirit is brought 
up against us. 
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Even af yon nro very' small and only playing with a big rubber ball, 
to Imow tlint you must catch it ovory time it is thrown to you and to 
liave missed a catch means lliat you liavo lot your side down. Then 
you feel that you do not want to play any more, but by the time you 
nave loft j'our first school the only desire is to got into the school team 
because you Imow that you will never let your side down. 

I class-room is so individuaf. The only person who is 

let do\m if you do not work with a will, is yourself. There is no one 
else to be disappointed except your parents who nro sorry that you have 
oen disappointed yourself and the mistress at school, although I find 
slie IS rarely given a thought. 

In both work and games wo have a goal and that goal is to win what 
we want. In work if wo fail, wo say wo will do it next time but in games 
if one fails tho rest fails. 

. l-oo many games lessons and matches in school life. Yet 

^ of them I should feel both 

inaignant and disappointed os cvorj'ono else would. But to miss 
lessons because of a leturo or concert is bliss. 

rnn i!oo ^ everyday life, and ns tho boll has just rung and I 

nnltr • V. round tho notice board outside tho door, I can 

in sc^^ol life°^ there, and tliink there can never bo too many gomes 

A^o. 46. 

Essay A 

All work and no play . . . 

Games and the pupils future. 

(а) Physical effect of gomes on pupils. 

(б) Mental effect of games on pupils. 

(c) Association between master and pupil. 

(d) School life without games. 

Games should be upon an equal status with learning 

in the school curriculum. 

and^nm *bat children go to school to acquire knowledge 

thev lean w ®wch people do not trouble to look before 

under the ^“®Y they would not despise games as not commg 

amona tho i-itW,’ ® knowledge. Nowadays, if one wants to be populM 
present snor+n n?" people, one must have an ordinary knowledge of the 
“^ 0^1 the present political situation. . 

at all, their ment^ school the pupils had no chance of physical exercise 
meataUv fit nnri would suffer for to be physically fit is to be 

Seafeler^^ ^ce-versa. Thus, it can be seen that some form of 
advantages it pupil. In addition to the other 

K aSl of of bettering the pupils health, 

siderable period ponm'tf ® t. ’^oo™ IwP oI books for a oon- 
took, they woidd h + observed, I feel sure that whatever form they 
the child wo^deitp! to the health of the child beca,use 

and in either case tho^ ^Y miserable all the time 

Games are not onl-o- wpon his mental health would be bad. 

health but also form for the good of the child s 

this is because it is usual fn/+vf o^ective link between master and pupd • 
them, while the unriPo master to arrange the games and control 

wnue tJie pupils play them and thus the master has to have a 


Main Theme 
Introduction 
Main Parts 


Conclusion 
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loiowlcdgo of tlio panic to control it, similarly tbo pupil, to plav it 

nnd^thus n common note is struck botiToon thorn. “ ’ 

Without panics it ivould be putting things mildly to say that school 
hfo ■would be intolerable, for it would bo mental torture for the masters 
and both mental and phj-sical torture on tho pupils. Tho mental torture 
for tho master would come from tho fact that tho pupils would bo 
thoroughly miserable and utiablo to absorb knowledge with their 
customarj' readiness and this lack of interest would make itself shown 
in the ill-temper of tho nuustcr. Tho pupils would then suffer for tho 
temper both mentally, by tho impending physical punishment, and 
phjTically, In* tho punishment. From this it can bo seen that tho 
indirect cause of all this trouble is a lack of ph\-sical exorcise for tho 
pupil, in other wortls, little or no games. 

From tho proceetling parapnrphs it can bo deduced that for the good 
of master imd pupil, in fact, all those connected with tho scholastic 
establishment, tho place of games or pln’sical exorcise in one form or 
another must play just as imjiortant, or nearly ns important a part ns 
tho acquiring of academic lamwle<lgo for it is obvious that with games 
and learning it is a case of — “ Together wo stond, di\ddod wo fall ! ” 


No. SO. 


Essay A 


How tho word "Sport "makes the heart of many an English Schoolboy 
boat foster. In tho Siunmor, cricket and tennis ; in tho Winter football 
and rugby, all of them goo<l healthy games which have helped a great 
deal in making England such a fine countrj-. IITint onjojanont tho 
youthful schoolboy finds in imagining himself ns a Herbert Sutcliffe, 
Patsj* Hondren, or Dixie Doan ; and one may 503’- that tho greatest 
follower of tho " Big ’’ Sport- is tho scholar. 

Undoubtodlt’ games pln3- a great part in School Life, and it is expected, 
that thov should do. The boA- who sits in a desk crouching over books 
for a great part of tho dn3’ is' in need of a regular relaxation from the 
old routine. Some form of this is prox-idod b3' g3annasiums, with wluch 
most of tho schools are now equipped. Even tho smaller and ill-fitted 
schools cany out their regidar " drill." 

Games should not, howo\-er, interfere with tho senous work, but it is 
sometimes unavoidable for ones im'nd to wander roimd the latest score 
of tho Tost Match, and tho " como back to earth ” when the master asks 
an unfortunately timed question. But there is no doubt that in many 
cases tho sport enables ono to tliinlc quicker, and also gives a very 

wolcome break to tho master. , , , 1 i j 

In recent years tho importance of school sport has been impressed 
UDon the minds of people by moans of tho newspapers. It is considered 
that tho only way to ha-vo a strong and healthy country is by constant 
nhvsical training. Unfortunately tliis policy has not been followed by 
Great Britain until just rocontlv, and consequently wo are rather beliind 
several of tho European Countries. Much of tho driU of the European 
countries in some cases compulsoij-, is carried out with a “ clockwork 
nrocision’” which is woefully absent in tliis countij-. 

^ Howowr, tho lack of tho games is now well on tho way to mend, 
and ns weU ns tho schools’ phs'sioal drUl, tho unemployed are given 
similar chances to keep fit own though lack of work may cause drooping 
spirits. 
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But even through these hard and trying times the old British sport 
and sportsmanship "will continue unforgotten, and the names of great 
cricketers and footballers will hold a very high position in the minds 
of schoolboys. 


145. Tbe following are 
Impression for four essays 

tbe marks for 
on subject Al : 

■ Sense 

and 

General 


Examiners 

P 

Q 

R 

S 

T 

U 

V 

W 

Range 

2so. 46 j 

1 Sense 

1 

2 

8 

2 

2 

5 

9 

5 

8 

L General Impression 

3 

6 

6 

2 

4 

7 

7 

6 

5 

No. 74 ] 

< Sense 

9 

5 

7 

4 

9 

8 

5 

11 

7 

L General Impression 

8 

8 

7 

5 

9 

9 

7 

12 

7 

No. 85" 

r Sense 

11 

13 

12 

7 

4 

9 

11 

12 

9 

1 General Impression 

11 

13 

12 

7 

6 

10 

11 

11 

8 

No. 91 { 

L General Impression 

6 

7 

11 

10 

9 

13 

9 

14 

8 

6 

6 

8 

10 

9 

12 

8 

13 

7 


146. We quote below the essays of Nos. 74 and 91. 

No. 74. 


Essay A1 

Shoxtld Games be kegarded as a Duty ob a Pbeasure 7 

^ This subject would be a very popular one at a school debate as roost 
girls and boys have very strong opinions on the subject. I think 
more people regard games as a pleasure than as a duty because they 
enjoy outdoor games. Some people find pleasure in some duties and 
th^ may think of games as duty and still enjoy pla 3 dng them. 

Games are always included in the school curriculum nowadays. 

seem to regard this period for games as a pleasure, when 
they do not have anything difiicult to do, and where not so much 
concentration is needed as in the form-room. Those who are good at 
games most certainly do look upon games as a pleasure but it is doubtful 
whether those who are not good do as well. I am not very good at 
games but I do enjoy them and find them a pleasure as much as those 
who are good at games. It seems to be such a relief to leave the form- 
room and go out to play games more so in the srunmer than in the winter. 

hink most people enjoy the smnmer games more than the win^r 
ones. Rotmders, tennis, swimming and cricket all seem more enjoyable 
an the wmter games. This is, of course, a matter of opinion. Although 
enjoy summer games, I think there is nothing more exciting fo.S® 
P™y hockey when it is very cold and frostv ; as the cold wind 
nm 'es you feel so fresh after playing for about half an hour. I personally 
regard garnes as a pleasure because I enjoy playing them, 
j people may regard games as duty because they think it w 
makes them more healthy. Some people like one 
whiVVi that those games that they have to pl®y 

wmch they dishke they would consider as a duty. Different types of 

nnA games as a duty. Those who are fond of drawing 

their ® fond of reading and studydng may consider that it is 

tw P v'’ may not find much pleasure in playing 

Sri nanfrou ^ o'lt of doors or playing games 

would naturally look upon games os a pleasure. This shows that you 
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have to think of tho typos of people before you can decide whether 
games should be n'gnrdcd as duty or a pleasure. I’ooplo who are fond 
of drawing and studying may also find games a pleasure but I tliink it 
13 more likely that they would find them a duty. 

People of the outdoor tJ^)0 who play games for the pleasure of playing 
would naturally play better. I nlwaj-s think that you naturally do a 
tiling better if you are enjoying it. ‘ Tiioreforo, the people who play 
games liecauso they find it a pleasure will play better than those who 
con.sidcr it a duty. 

You how to consider the question of the time when you play games. 
At school you liavti to play games and those people who find it a duty 
would not like this. Out of school if you want to ploy games you may, 
but if you do not wish to you aro not forced to ploy. TJioso people 
who play gomes out of school naturally find it a pleasure or olso they 
would not piny. 

As so many people play games out of school hours I tliink that more 
people find games a pleasure than a duty. This of course is to an 
advantage as naturally games will bo plaj-od bettor; theroforo games 
should bo regarded ns a plcasuro nithor than a dut3\ 


Ko. 91. 


Essay A1 


SnooxD Gajiks de becarded as a Duty on .a. Pxjiasure I 

If games aro to bo regarded as n dutj' or a ploasuro there must be 
Eomo inwciblo reason for tho choice, and in choosing certain important 
factors must bo tokon into consideration. 

If tho}' should bo thought of ns a pleasure certain questions must be 
solved. Tho aim of games must first bo taken into consideration. 
There are various reasons why wo plaj' games and the main one is 
in order to obtain relaxation. Tho game may bo a strenuous one but 
it has nocessitntod tlio uso of channels of tho mind not emploj-ed in 
overj* daj' incidents. From this relaxation tho development of another 
side of our nature is in progress. AVo learn the sporting spirit of give 
and take, and wo bocomo fairer in our judgements, therefore wo are more 
suited to be citizens of tho community. Those games usually take place 
in open air and as thoj' all involve swiftness and precision those playing 
them dcvelopo a higher standard of physical fitness. 

Despite tho encouraging results of taking part in games, they have 
a definato place in communitj’ h'fo and are not to bo regarded as of 
primarj' importance. Tho\- aro essential but cannot bo thought of 
as more important than tho overj' day pursuits of working to obtain 
a living and thoj* should bo confined to tho times when work is disgarded. 

The greatest joy in games comes when the particular game is first 
mastered. As efficiency is gradually acquired, the game adopts a more 
serious aspect. Tlien thoughts of proving one’s abUity are entertained 
and competition takes on important place, but despito this there is 
onlj' a small section of tho communitj'^ who ploys games professionalls'. 
The others regard them ns being somotliing to enjoy and ns being superior 
to any indoor amusements, croeciallj’- during the summer months. 

AVhen regarded as a duty' v'et another aspect of them is entertained, 
that is of tho results of ployhig games. Then wo find that people who 
plaj’ bocomo strong and athletic, and have more resistance to illness 
and can therefore work better. Tho control of growth, of straight 
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limbs and square shoulders can bo assigned to games. Therefore 
mstead of a nation of physically unfit people, wo got an A1 nation of 
strong supple men. During times when political disturbances are felt, 
the health of the nation must bo of a high status in order not only to 
defend their country if need be, but to command the respect of others 
and to bo able to make political agreements with the knowledge that 
their will be no hesitation and that one’s country ^rill follow one. 

Another and important duty is that to posterity. We owe it to 
the nations to come to bo of a high standard of good health ourselves 
so that they may be the same. Games should therefore play an 
important part in attaining this standard. 

^Vhether thought of as a duty or as a pleasure we can see the 
essentiality of games. They should bo regarded, primarily as a duty 
but as they give pleasure, as a pleasant duty. They should be enforced 
as long as they keep their correct place and the youth of the nation 
should, by being taught how to enjoy them, learn a true standard of 
their value. 
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No. 12. 


Essay B 

This sceptred isle, this earth of majesty. 

This^ fortress built by nature for herself 

Against mfection ... Shakespeare, 

^ere axe still ^ny Britishers who strive to regard England to-day 
e nataon which leads the world and which all other peoples look 
o or gumance and with respectful envy ; and they are truly noble 
^op e who would, in their imagination at least, see England as 

although we who inhabit this tiny island 
population of the world, and this isle itself 
T Hutr ^ foOT-hundredth part of the area of the world, we are, 

, ^eatest nation. Those who dispute this, do not know 
else ®°gli®hman, and as proud of it as of anything 

while an? i World in the things which are right, worth 

hie?1ir do ^natter she does not, 

iTond ^ improve them, remedy them substitute 

fs ^ ii England has always succeeded, 

IS succeeding, and will succeed. Her success in such a task is inevitable. 
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Manj- cluldish rountrics Imvo with such potty things ns embargos, 
tiiroats, warnings nnd accrtsutions tried to prevent ns — tlioy ox-on dared 
totrj- tocriM/iiis ! So mighty wore their arms. But they wiil nox-or cause 
the x-irtues of an Englishman to xvax-or. 

Throughout the centuries, sinco long before dictatorships or swastikas 
xvero thought of, England has been steadily, continuously ostablisliing 
her present position. She has nox-or tried to conquer the xvorld in a 
fortnight, bxit alxx-ax-s strix'cn to reform the world — for ox-er, 

Vohimcs nnd x-olumes nnd x-olumcs of literatuno has been xvritten 
in pimso of the so-called good Old England, of the gallant sailors of 
the sixteenth, and of our soldiers tlirough tho ages. Those could only 
hnx-o been of tho one Great Coimtrj-. 

Ex-en with tlio ndx-ent of comparatix-oly modern monsters — those 
huge grey .ships, and massix-o torpedoes, nnd submarines, nnd aeroplanes, 
nnd airships, nnd donth-rax-s — yes, ox-on xx-ith all these nnd others, 
England is not mox-cd. 

She abhors those things, but still is as calm ns ox-er. 

She adapts herself to tho now conditions — for any sensible state must 
do tlus — nnd at tho same time does tho job xxull, but at tho same time 
nox*er ceases xx-orking for tho good, not only of herself, but of tho world. 

TJiis is the tiling to bo remembered. Tho rm'nor states of Europe — 
they may hax-o amuos of rm'Ih'ons nnd m‘r forces unimaginable but they 
are still only x-orj- minor states — these states xvork only for their oxxm 
beneOt. 

They are greedy, selfish ; xvant ex-erybody olso's territories, money, 
and goods, only to squander and despoil xvhon they hax-e them. But 
England is tho opposite and as opposite os anjdhing could bo. 

A small but infinitely great country ns beautiful as to be unique in 
tho x-arioty of her scenerj", xx-ith her ox-ery members concious of the 
glot>' of his fatherland, and of its xmpamllelod record of good work 
towards tho perfecting of all tho lessor nations (who do not ox-on Imow 
thomsolx-es what they are really trying to do, — or what they will do 
when they have done this) — tliis is the England which exists TODAY, 
if only all could realise tliis. Wo do not more than necessarily boast 
of our past and future. Wo broadcast our glorious Present. 


No. 84. 

Essay B 

“ Tliis emerald isle sot in a silx-er sea," said Shakespeare, speaking 
of liis natix-o land, England, and echoing and re-echoing doxvn the 
ages hnx-e come stories of tho pomp of her Idngs, the glories of her 
triumplis nnd tlio might of her people.. Her throne alone has stood 
secure, since the days of I^ng Alfred, nnd still through the centuries 
come her kings xxith stately tread nnd sweeping x-elx-et. The steady 
boat of tho drums of her xmx-anquished armies resound along the endless 
path of time, and lead their people to glorious x-iotory. 

Yet wliat is all this might, this grandeur, xrithout something deeper ? 
Has England onlv outward splendour ? No, deep in the xvorks of her 
poets, her authors and painters, treasured in tho heart of her people is 
something xxdthout x\-hich she would bo nothing : the faith wliich keeps 
her true to her kings, the lox-e for her felloxxmien, and tho humility which 
still alloxxs her to acknowledge that there is one King, whose beauty 
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lovo and Rlory far mirpnfi-sas tha of Imr Idngs. Without thH 

Plio would bo notliing ; sho ban bo much pndo, and yot tlio worsliip oi a 
Great God can mako her feel tio very* htjinblo. In the plorj' ol nor 
cathcdmiR. in tho Bolcmnity of her churches in tho heart of Ovor> truo 
Entdishtnan in found the l)cauly of our religion. 

The rugged hill*? of tho north lift up their heads to tho hoaveas. ani 
tho quiet green meadows of the south hatho in tho caressing sunlignt- 
What countrj' can give anything so fair as our countiyside m t ^ 
spring 7 Around one is the singing of tho birds, the 
teinrK>stuou3 streams which hurl themselves from the hilLsido. •< 
one is a dappled sky, whore a fickle breeze chases tho fleeting c o • 
This is tho country whore men are bom, poets, statesmen, soldiers 
sailors. Tho sailors of tho west sailed tho seven seas, and brought Jiome 
to England fame and riches. With the help of a few ® 

and stout hearts to man them, the\' brought the might of bp * 
Armada to nothing. Where were tho Spanish admirals when -Ura ' 
dmm thundered across the seas 7 i. i fnr 

Tho mighty Napoleon, driving all before him was no 
England. Nelson in his Victor}*, saved the day and so^ Napo > 
tho proud, tho mighty, began his humiliating journey to Elba. _ 
Again and again, with glowing pride tho Englishman hoars stone 
his countr}’’8 glorious histor}*, and as tho armies tramp along, and as 
kings come sweeping by, yot still ho hoars tho grander, nobler voico 
the one King. 

149. The following are the marks for Sense and General 
Impre.5sion for four essays on subject B1 : — 
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The essaj's of Nos. 40, 46 and 58 are all regarded by four or 
more of the examiners as below the border-line of “ competency 
(8), in either Sense or General Impression or both ; but No. 40 has 
received a mark of 10 from one examiner in both categories , 
No. 46 has received four marks of 10 or more for Sense and three 
of 10 for General Impression ; and No. 58 has received two marks 
of 10 or more in both categories. The opinions of the examiners 
in regard to these essays are clearly irreconcilable. 

150. We quote below the essays of the tluee candidates above 
referred to : — ■ 
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No. 40. 


Essay B1 


[Eose Cottage, 

Chester Eoad, 
Southmore.] 

Dear Marie, 

In your last letter you praised France so much, that I can do no 
other than show that you are wrong in sajung France is the best country 
in the world. 

Although England is my own oovmtTy, I’m not going to praise it 
because of that, but because their are so many things that make it 
stand out above other countries and lead them. Surely if England were 
not the leading country it could not defend and please such a vast 
widespreading Empire as it does. 

The English parliament is a model to other countries for it thoroughly 
goes into every detail of any question or misunderstanding which may 
crop up between parties, two firms or even the employees of a firm 
over the question of wages and hours etc. 

English politicions are always watching other countries and when a 
diflioTdty arises there they are onlj’- too willing to help straighten it out, 
although they are very careful not to be drawn into any war. 

There are verj' few changes in the parliament, changes only taking 
place when a leader or any member dies or retires or at the general 
election when it is compulsory for everj'one to be re-voted. 

Everj'one can go to bod at night with a safe feeling and not worry 
whether anarchists are going to rise up in rebellion during the m‘ght, 
for everj’one loves and respects the Royal family and monarchy. 

It is also quite safe to go out for gansters are practically imheard 
of in England except through newspapers and films of foreign countries. 
Of course I’m not sajnng England is absolute!}' free from criminals 
because it is not, I do not think that any country could be but Scotland 
Yard is very particular about the crimes committed in the British Isles 
and a strong record is kept of every criminal. Some of the most 
up to date methods are used and very few people escape from " the 
clutches of the law.” 

The country itself is very pleasant to live in for there are no dangerous 
wild animals rmd reptiles to watch for. The atmosphere is pleasant 
and people willing " to help lame dogs over styles.” In summer it 
is never xmbearably hot and in winter it is never so cold that people 
get snowed into their house and frozen to death. Although England has 
her share of rain it does not rain every day and all day while on the other 
hand it does not suSer from drought. 

Many pleasant walks can be taken in the country where nmnerous 
wild flowers grow in their natural surroundings along the hedgerow, in 
woods or by the sides of streams, ^^^uchever month of the year is 
chosen for a country walk their is always something to see, and there 
are alwa 5 's birds who cliirp and wake one up on a summer morning 
or visit daily for crumbs during the winter. 

Being an' island there is plenty of coast and fortimately there is a 
tide all round the coast wliicli means that the beach is washed twice 
daily and therefore are quite healthy for the dirt gets carried away. 

Poets all tlirough the ages have been fond of praising England for 
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her beauty and power. It is not only parts of the country that are 
described in verse but statues, Idngs and towns. 

One poet wrote of England 

“ This Royal throne of Ivings 
This sceptered island 
This earth of majesty this seat of mars 
This fortress built by nature for her purpose 
Against infection and the hand of wars.” 

Another called it the “ fairest Isle ” and said 

“ Fairest Isle all isles excelling 
Cradled mid the western seas.” 

Many emigrants on far shores have pined for a sight of the coast of 
England and written ; — 

“ Oh ! to be in England now that spring is here ” realizing her beauty 
and what they are missing. 

To many colonials returning to England for a holiday after longs 
years abroad in the backwoods and jungles of Africa, the bush of 
Australia, a lonely ranch in Canada or military service in India have 
welcome the sight of the “ white cliffs of Dover.” 

This seems more of a lecture than a letter so I’ll close before it gets 
too bad. 

Please give' my Idnd regards to your parents and write soon. 

Best wishes, 

from yoim pen friend, 

[Lnoy] 


No. 4G. 


Essay B1 


England is without doubt the greatest coimtrj’' in the world. We 
have honour, prestige and tradition. 

England has produced the greatest man in literature throughout the 
whole world — , in the person of William Shakespeare. France, Germany , 
Italy, have never produced such as genius as him — that is something 
which I think Englishmen should be proud to Imow. We have not got 
only one great man in literature either for names such as Milton, Shelley, 
Wordsworth might well we ranked with names such as Dantes, and it is 
an admitted fact that France has never produced any great poets. 

To say, that England is better than any other country in the matter 
of scenery, is, I think an injustice, for wliile England does not better 
them in this respect I think it is certainly at par with them. In most 
countries such as Norway, Sweden, Switzerland, Italy, there is so much 
the same, over large areas, but in England we have variety in our 
scenery and “ Variety is the spice of hfe.” We are not confined to 
mountains, rivers, plains, for our beauty, but we have the whole lot 
moulded into one. In England if you want hills and mountainous 
scenery you go West and North if you want flat expances of country 
go east to the Fenlands, if you want gently undulating countrj’’ go 
South to, Sussex, Kent and Hampshire. 

England is by far the safest country in Europe, this statement finds 
prove in the fact that many exiles from foreign countries on the 
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Continent find a refuge and ha^^n in England and names like Haile 
Selassie, from Abj'ssinia, King Alfonson from Spain, instantly flash to 
ones mind, and Colonel Lindenburgh could not find refuge in the 21- 
million square miles of the United States, but found it necessary to 
come to England and find peace in the Weald of Kent — at Sevenoaks. 
Therefore this prows does it not ? that England is safe and provides 
a hospitable hand to foreigners. Perhaps an even more striking instance 
of the hospitality and generosity of tliis coxmtry is the shelter aSorded 
to the 4,000 Basque children who have just come from Spain to find 
shelter and peace from the bombing in their own coimtiy. 

Perhaps in the matter of roads England is inferior to some countries 
such as America, but one must remember that England is an old 
countrj', the houses and roads have been built to suit the conditions 
of horse traffic whereas those of America have been built to suit motor 
traffic from the first. JIany foreigners, especially Americans accuses 
England of shuns and lack of town planning, but they forget that 
England has taken about 200 j'ears to make her towns and cities 
especially the manufacturing tornis such ns Mnncliester, Leeds, and 
Birmingham, but most towns and cities on the Continent of America 
have been created during the last 100 years. It is an admitted fact 
that Continental railwaj-s are not as good and safe as English railways. 
In France there are more accidents on the railways than there are in 
England. In France an engine driver is paid according to time he 
takes to make a run, and receives a bonus if he makes the run above the 
scheduled time, of course tliis encourages liim to speed and consequently 
heighten the risk of accidents. 

The speed of the French taxi is famous, but surely this is not a good 
reputation, it is much better to tra%’el a little slower and so lessen the 
risk of accidents. .Although the death rate from road accidents is 
liigh in tliis country I tliink it compares favourably with other countries. 

Concerning the question of Empire, it is surely a fact, that we possess 
the greatest Empire the world has ewr known, and the bed rook 
foundation of it in my opinion is the king and monarchy — coupled 
with democracy. Our Empire will last forever in my opinion, it it 
remains on its present basis — it is the greatest factor in world peace, 
and while the Dominions of Canada, South Africa, and Australia, have 
their own gowmments, and are allowed to manage their own affairs, 
they will cling and support the Mother Country for ever. 


Then, as number of tilings in tius countrj'- in this countrj- ^nt 
nationalising and thej- want it badlj-, — coal rmnes, gas, electricitj-, 
water, and all communications -want to bo brought imder government 
control ns thoj- are in most continental countries. Our farming is in 
a mire, it wants fertilising, — and nationalising as it is in Denmark, — • 
wo could become much more self supporting and independent if we 
made a “ Ketiim to the Band ” as France, Italj-, and Germany are doing. 

Even so, England is considered bj- most people who hare trarelled 
and exploit to bo “ the best countrj' in the world.” Our democracy, 
liberty, of the press, speech and rolipon, are a national heritage and 
knock dictatorships and despotism into *' cooked hats.” M e must 
safeguard and uphold these rights, and never let England down, bat 
keep it the best, most free and safest country in the world. 
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JS^o. 58. 


Essay B1 

In PiiAisn or England 

Any Englisli man who has been abroad for some timo will find many 
things to say in praiso ot England. Almost any man would have this 
fooling for his Native country, but with tho English people the feeling 
is supposed to bo greater. Although pcojjle go abroad for holidaj'S, 
they are alwnj's glad when thoj* see tho familiar English countryside, 
and hear tho countrj- accent. 

England started very insignificantly, a very small island “ Britannia,” 
it was almost wliolly ignored by tho Romans, and tho first real conqueror 
was Hadrian. Then lator, after tho Romans had loft, Scots and Danes 
mvaded it, plundering and dcstojung. AVilliam tho Conqueror brought 
in Freneh blood, and England was really a mixture of warlike pooplo. 
And So England grow from an islo inhabited by savages, to a land 
with a hugh Empire, ono of tho foremost in tho world. 

English soldiers have won fame overywhero and, os Napoleon said, 

They don’t Imow when they are beaten.” It is this that has made 
England’s namo for her. Tho bulldog is a good emblem of British 
pluck, as it holds on and won’t lot go of its object. Tho British Navy 
is tho oldest in tho World, and is called tho “ Senior Seiwico ” as it 
was formed before tho Army. Alfred the Great founded tho Navy 
to guard against tho Danes and Vikings. Tiro Roj'al Air Forco is very 
new, but it had a chance to distinguish itsolf in tho World War. Part 
of it acts as policemen in Eastern provinces, and has helped a lot in 
subduing risings and rebellions. 

The British Police are a model to any other country, and although 
the English policeman is depicted as a fat blockliead, he is not so by 
any means. They help to make English towns wliat thoj’^ are, and 
although “ colour^ lights ” are used for regulating traffic now, England 
cannot do without policemen. They help to make London the first 
city in the world. 

As a contrast to towns, there comes tho English countryside. Many 
p^ms are composed about it, and many pictures painted of it. In 
different parts ^ of England, there are, naturally, different tyx»s of 
country. In Kent there are many hops, orchards etc., while in the 
Midlands there are many sheep. It is a very beautiful sight to stand 
on a MU and gaze down on different fields. Some are yellow with 
some green grass with cows on it, and some with vegetables etc. 

The greatest blot on England are the “ slmn ” and “ factory ” areas. 
These were started and made half a century ago, but now England is 
domg^ her best to clear out these “ special ” areas. Carlvle attacked 

^ 7^ T quick industrial manufacturers in his essays, and 

gr^tly helped to bring about a great change. The employee, at a 
factory today is greatly helped by the “Unions,” and the special 
areas are bemg changed. 

in the world, and the 

tog-emperor is the first person m the country. The loyalty of the 
questionable, and- the thought of the King helps 
to bMg about many a great desue. Although a kingdom, England 
IS a truly democratic country, and honourable. ® ^ 
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161. The following are the marks for Sense and General 
impression for four essays on subject C ; — 
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60 and 77 and 85. 


May 6th 1937. 

Material . — Beason for speech daj's — opportunity for parents to see 
boys and naasters, how school is run. Speeches made by members of 
company, and chief masters. Distribution of prizes for end of school 
year. After the speeches, they go down to ground and watch the 
cricket. Teas in the tents. Spoilt when raining. 

Plan 1. Beason for school speeoh-da 3 rs. 

2. Start of a school speech-day. 

3. Speeches by masters. 

4. Opportunity of parents to see boys and masters. 

5. Prizes at end of school year. 

0. Afternoon at the ground. 

A School Speech-Day 

School speech-days are usually organised at the end of every school 
year, and aro held in the mornings, on the last day of the term. They 
enable the parents and boj’s who aro invited to h'sten to an account 
of the doings during the school year. The masters give this news 
which also includes any new reforms introduced into the school. Also, 
at the end of the morning, by which time the speeches and prize-giving 
are over, parents and boys can go down to the groxmd, where the boys 
play wliile the parents watch. 

MTien the parents and boj-s have assembled in the morning, the 
speeches begin. The masters of the Company who own the school 
then make speeches and give some idea of the work of the Company. 
The Headmaster thou spoalrs and sometimes the Head of the school 
makes a speech in Latin. 

After these speeches the prizes are distributed to boys who have 
won them during the school year, either for their general good work, 
or on the results of the summer examinotions, held a few weeks before. 
The prize-givung is rather an ordeal for the boj-s unless they have plenty 
of self-confidence. 

The afternoon down at the ground is very pleasurable if the weather 
is good. The parents are at liberty to wander round the ground and 
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No. 60. 


Essay C 


A School Speech-Day 
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«-ntch tlio various games going on, of which there aro often a dozen on 
speccli day. There is nlso n side composed of father? who play cricket, 
and tliis plnje? a side from the tichool. When the games have finished 
for the tea interval, everyone is provided for, witli the aid of a largo 
tent. After ton, the games continue while Fomo of the parents return 
home. 

A speech-day is quite spoilt wlien then* is rain, for the parents have no 
opportunity of Fconing the ground, and the hoys playing cricket. 
However, the morning Bpeechday is nlway.s on interesting nfinir. The 
parents can inspect the school huildings and the bojo?’ form -rooms. 
Thirtj' years ago these speech days were much the same thougli the 
parents then had no opportunity of seeing the groimd. The speeches 
have not difiered much, especially the last words of the Headmaster — 
“ The Term is ended.” The school i.s complimented on its performances 
during the last year, and are exhorted to do oven better than this 
during the next school year. Finally the boys are told to enjoy the 
holidays and come hack ready for a good term's work. Then ovorj'ono 
files out and another school year is over. 


A'o, 77. 


Essay C 


A Senoon Speech Day 

Practically every school has a speech day some time during the 
year, and ours usually comes late in November. Personally Fyo 
alwaj's thought it would bo better in the summer, because as it is, 
it invariably ‘ poius in torrents,’ and Htorily damps everyone’s feelings ; 
certainly a large number of speech daj's are summer affaires, and from 
reports I have heard of them, very successful too. Not that ours 
isn’t, but why not take more advantage of the longer summer evenings, 
and even go the length of ha\-ing it out of doors 7 It would at least 
be original. 

However, as it is, wo meet every November in either the School 
Hall, or the Town Hall, — that point depends on finances, — and sing, 
listen to speeches, and clap at intervals. For hours preriously, one 
can imagine countless mothers scrubbing countless oars and necks all 
over [name of a toivn\, and pushing, and sowing numberless girls of all 
ages, and sizes into a variaty of different white frocks. For wo wear 
white, and look like angels, and by the end of the evening, feel quite 
the opposite. We are not given programs, so that any paper required 
for playing noughts and crosses has to be brought in with you, but 
fortunately we have not had to resort to that type of entertainment, 
at least as far as I know. By far the most interesting speech day 
that I ha\'e been to was the last one. It was in the Town Hall, and 

hearing ’ was very much better than usual, which was fortunate 
the speaker was genuinely interesting, and did not have that irritating 
habit of ‘ talking down ’ to her audiance, or making feeble jolks at 
which one was obh’ged to titter gently. 

By far the most important part of the whole ofBcial evening is the 
singing, upon each one of us depends a great deal, and those who 
sing seconds ’ feel suddenly, and unexpectedly that they can’t 
remember their note, and much humming goes on under their breath. 
Actually, of course, every thing goes off perfectly, the music mistress 
breathes again, and we all collapse into our seats with sighs of relief. 
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Then follo^T8 the Hendmistrossos report which contains mucli sound 
ndx-ico to parents, who, poor things, nro stacked away up in the gallery, 
mother wondering if her child’s stocldng has fallen down yet, after 
having broken ono suspender os she loft the house, and father looldng 
interestedly nt the staff who endovour to hammer sense into his infant. 

. I often wonder if our staff get a few, not unwelcome shoclra, on 
Speech Day. They meet our parents, and ones character is pulled to 
pieces, wliilo ond fidgofs idloly, waiting for them to finish tnlldng. 
Completely now ideas must bo formed regarding girls after the fonn 
mistress has met the mothers, also she must fool a little different towards 
her girls after ha\dng seen them in long white frocks. This applies 
notably to tho older forms ; on ordinary days, in an ordinary brief 
gj-m-tunic, n girl looks very little older than fifteen, but on Speech Day, 
liair done properly, frock long and daintily made, a girl suddenly grows 
up and becomes someone totally different. That is gain to the staff, 
but Speech Daj-s not only holp thorn but the parents also, ono must 
not think of such a da}- as only speeches, songs, and prize giving. 
There is far more to it than that, mother and form mistress meet, 
co-operate, and begin to understand tho part each must plaj' in tho 
growotli of a girl. 

But I have tarried long in this part of Speech Day, not a fault my 
reader will condemn I hope, to my idea, this part is more important 
than tho main ‘ Prizegiving,’ but perhaps that is because I have 
never received a prize ! Even so, ono wishes that the girls could play 
a greater part on tho SjJecch Day, other tlian by singing. The Hoad 
girl makes her speech of thanks to tho visitor, ond we nro nil there in 
our white rows, but sometimes feel that wo nro looked upon as nice 
little girls singing nice little songs, — if they only knew ! 

Therefore ono comes to tho conclusion that there nro two parts to 
overj' Speech Day, or there should bo if there isn’t, tho official part, 
and tho unofficial, both important, but the letter most definitely so. 

So vear after year wo shall look forward to Speech Day, Imowing that 
one" will sing, clap, and listen, ond finally hoar ones’ bBha^^or being 
discusses, and, frequently condemned. 


iS^o. 85. 


Essay C 


A School Speech-Day 

Tho thought of Speech-day is first brought to the minds of the pupils 
when tho date of tho event is announced, probably after prayers, in 
tho main hall by tho head mistress or a mistres deputising for her. 
Sometimes a few minor details nro given nt once but these usuall}'' 
come at a later date when they hove been gone into more fully. 

Preparations for tho day begin f/t considerable time before tho event 
is to take place. The music has to bo chosen by the cliief organiser and 
tho place for tho pupils have to bo arranged carefully in order to allow 
enough rooms for the parents who will attend. Wien all tliis has 
been done there must bo several rehearsals of the anthems, songs and 
musical interludes so that evorj-tliing shall be cut and dried for the 
day itself. This moans often that lessons must be interrupted at times. 
These interruptions are sometimes welcome, especially if the lesson 
is somewhat dull and uninteresting. At ot'-er times, lioweTOr, when 
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a lesson is interesting or the loss of a lesson ■nill mean that the class 
■will become more backward in its syllabus, the interruption is annoying 
and inconvenient. This may often occur but if it is unavoidable it 
taken in the best possible spirit. 

^ J^e at the period is not always a bed of roses. Annoying little 
mcidents may occur to put one’s nerves on edge. A song may have 
to be repeated again and again before it reaches the standard required 
by the organiser, if it ever does. Sometimes, the whole school seems 
to all sense of direction and muddles ensue which have to be righted 
at the waste of valuable time. Often the return of an absentee puts 
a whole section out of order or a pupil may take it into fifq or her head 
to move his or her position in order to be near a friend. 

At last, however, the preparations are complete and the day itself 
amves. ^ Last minute instructions are given and minor details arranged, 
^^e pupils are marshalled into their places and parents conducted to 
their seats. 'Hien the distinguished visitor, who is to present the 
prizes Md certificates, arrives and the programme is ready to commence, 
^ometimes a parent arrives at the last moment and room has to be 
naade for her. Then, to the accompaniment of the rustling 
o paper and the scraping of chairs, the ceremony is opened by a burst 
o from the school choir. Usually ever^hing proceeds quite 

smootUy though the musical interludes are not always given as much 
^ they might be given by the pupils. 

speeches begin they are attended to quite intently at 
n^- but after a while, unless the speech is very interesting, one’s 
^ V and it is sometimes with a feeling of reh'ef 

ttat the moment for presenting the prizes. There then follows a period 
ot prolonged clapping as the pupils go forward to receive their awards 
w e their less fortunate or less diligent associates look on enviously 
or imcarmg. 

After the distributing of the prizes their are usuallv a few more 
^eeches, mostly of th anks to the visitor and then once more the 
peec ^ay ^ over and the pupils and parents disperse to examine 
tne school building or return home to tea, after which the pupils 
wi enjoy an evening free from school work before returning to the 
never ending round of lessons again. 


153. following are the marks for Sense and General 
Impression of four essays on subject Cl : — 



Examiners 

P 

Q 

R 

S 

T 

U 

V 

w 

Range 

Xo. 4 

j Sense 

12 

7 

12 

11 

12 

9 

9 

10 

5 


t General Impression 

11 

10 

10 

11 

12 

9 

9 

10 

3 

No. 12 

j Sense 

6 

14 

12 

10 

12 

11 

11 

6 

S 

1 

1 General Impression 

8 

13 

12 

11 

12 

11 

12 

10 

5 

No. 15 

; Sense 

8 

14 

11 

8 

9 

12 

11 

12 

6 


t. General Impression 

8 

13 

11 

8 

8 

12 

12 

11 

5 

No. S8 

f Sense 

9 

12 

8 

8 

7 

13 

10 

12 

f, 


\ General Impression 

8 

12 

6 

8 

8 

12 

10 

11 

6 

154. 

We quote below the 

essays of Nos. 

12 and 

15. 
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Xo. 12. 

Essay Cl 

Oun Last SrEEon-DAY 

Never boforo Imvo I boon present nt a spcoch-dny quite like it, never 
itgrtin shnli I nttond tuiy function wliich lonvcs cjuito tho sfvnio impression. 
I shell never for^t it not boenuso of any extraorclinerily interesting 
speeches, overflowing with tho brilliance of tho speaker’s wit ; oh no ; 
there wore no exceptions to tho rule in that respect ! I shall never 
forgot this oc^sion bocn\iso of tho atmosphere that prevailed throughout 
it. In describing it ns a tense atmosphere of suppressed tediiun of 
even annoyance on tho part of tho school, of disgust on tho part of most 
of tlio visitors, and of extreme and obvious embarrassment on tho part 
of the headmaster, 1 should oven then bo convoying onlj' a most vague 
and unreal idea of what it was like. It was an ntmosphoro peculiar to 
the occasion and one that could only possibly exist on a school-speech dnj'. 

Now that I hoA-o attempted to “ get you into tho thing ” so to speak, 

I will give you n brief account of tho proceedings from beginning to end. 

Tho Slayor was to give tho prizes and perhaps there was some little 
more excitement than usual among tho younger boj-s — ^which lasted 
till about ten minutes after tho ceremony had started. 

Soon after wo had boon jumbled and justlcd into our usual comers 
and back-benches in tho hall, visitors started trickling in. Tho wore 
met by tho familiar din and clatter, but when tho centre of the hall was 
practically full of thorn, wo wore con\-inced that they wore making 
practically ns much noise thomseh'cs. 

There was tho usual touch of colour, supplied by tho masters but oven 
this seemed to disappear as, one by one, or, I should say, two by two, 
they hid themselves oway in comets, either to keep up a just audible 
running commontarj- on tho ceremony, or olso, determined not to have 
their daily routine disturbed, to toko their afternoon nap, which they 
are accustomed to take in tho history period. 

Only one or two masters wore prancing about on tho platform, 
throwing themselves and their most terrifying voices hero, there, and 
overj'whoro. It was humour nt its best to watch some of them trying 
to instil ideas of law and order into some of tho j'ounger juniors. 

(Old A was fussing about ns usual). 

It was soon twenty five minutes past two, the ceremony was to 
begin nt half -past. 

And so, true to tradition and all rules of ceremonial etiquette, at 
twenty-five minutes to three, tho headmaster entered tho hall, followed 
first by tho Jlayor in all his gilded pomp, and then by a straggling 
collection of decrepit and decaying governors. 

There followed tho awaited periods of deep tedium. First, the 
headmaster’s report in its proper, uniform, monotonous tone — although 
I think he surmounts tho difficulty magnificently bj' rusliing through 
it ns quickly os ho dare ; Secondly", tho actual distribution, amidst 
unending applause (this is practically tho only' time when the jum'ors 
can vent their feelings ns they wish) ; and, omitting other superfluous 
detail, lastly' came the Slayor’s groat speech. 

He open^ in the generally accepted way by- saying how pleased he 
was to come and give tho prizes (after cursing the whole tiring for all 
the previous week) ; he went on, amidst deafening applause which 
now developped into uproarious and hilarious laughter, to say that 
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he never won n prize when ho was at school (also, of course, the generally 
accepted way of continuing these speeches) ; and ho concluded (still 
keeping strictly to tradition) by rnumbling a tangle of inaudible rubbish 
about citizenship and wild oats. 

I distinctly heard sighs of relief when the whole thing ended ! 

No. 16. 

Essay Cl 

[10 Bakers Road, 

Southwick.] 

26.7.37 

' Dear Marj'', 

You did not miss very much by being absent on Speech Day, but 
I suppose you might just as well bo bored now instead. I am going 
to tell you exactly what happened. The event will probably be in the 
wrong order, but I can’t remember everything. In any case, it was 
exactlj'' the same as any other Speech Day. We never do get much 
varietj', except that sometimes we liavo a man as the chief prisoner 
of the day. 

To begin with, we all went into the hall at the back, nattually, and 
watched our beaming parents fill up the front seats, blocking our view 
entirely. Then the honoured ones arrived and filed on to the platform. 
We stood up to get a better view, but the parents followed oiu: example 
and we were lost again. I do thhik they might consider us just a little. 
I believe the prayers and hymns came next — don’t Imow exactly, 
but they seefn to fit in just here. After that we all sat down again. 
Then the chairman spoke. We could not hear what he said, but it 
was an awfully good speech. Somebody thanked him, and then the 
main speaker started. It happened to be a woman tliis time. May, 
I really wished you were there during that speech. I could hear every 
word and it was very interesting. Above all, the speaker actually told 
us two new jokes that were awfully funny. All the girls were absolutely 
®t'®ggered and nobody j^awned or spoke all the time the speaker was 
standing. 

_ I can’t remember very much after that speech except the prize- 
giving. There were so many prizes that I seemed to be about the only 
one not getting one. My conscience tried to give a twinge, but as I 
haven’t slacked any more than usual, it didn’t quite work. My brain 
cannot be as big as other girls’, that’s all. 

After that there were several other speeches thanking the first 
speakers and so on, followed by the Headmistress’s report. Several 
girls have done very well and got scholarships and all that this year. 
W e were all told to work hard, and then we might possibly do as well 
as they had done. 

Next came the most important thing of all — our play. So that you 
shan t be prejudiced, I will tell you a few criticisms I was not meant 
to hear. 

It was a bee-eautiful play, my dear. These little children ca-a-an 
act well.” 

Beastly thing — plays get worse every year, and as for Speech 
Day ones . . . . ” 

Very well done, very well - done indeed. My daughter was in 
it. Takes after me. Did you recognise her ? ” 


I 
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“ Haven’t the faintest idea vhat it vas like — slept through it all.” 

Now^ to continue. It was soinetliing from Shakespeare, and oiu: 
form did it. Everj'body said to us that it was magnificently done and 
that we were aU budding Greta Garbos’. You had better take that 
with a pinch of salt. The costumes were rather good, and everj-one 
Imew her part. I am much too modest to say any more, but you ought 
to know the form well enough to fill in any'' omissions. 

■When the play was finished, we all collected oiu- parents and went 
to the dining room for tea. Everybody naturally ate piles of food and 
those serving tea had a beastly job. Parents are in an awfully good 
mood on Speech Day. Daddy gave me a s hillin g. 1 told him he 
owed me one and ha didn’t ask what for. I only said it for a joke, 
but when he actually presented me with the shilling, I certainly was 
not going to enlighten him.*^ 

Do you know. May, I tliink that Speech Day and Christmas Day 
are the only day’s of the year I get any praise on t On Speech Day, 
the cleverness of the rest of the form reflects on everybody' and I received 
praise for the number of prizes won by the form and for the play. 

I think that’s rather nice, don’t you ? 

On the day after, the whole school was praised for its admirable 
behaviour and ‘ ladylikeness ’ ! That was because you weren’t there 
1 expect. I hadn’t better write any' more now, as it might tire y'ou. 

I tliink that’s a jolly' good excuse and way of putting a stop to the letter. 

I do hope you will soon be better and back at school again. Again 
I say — I’m frightfully sorry' you missed those jokes. I’ll tell you 
thein when I see you. Jokes always do look mad and not a scrap 
funny on paper. 

Goodbye for now. 

Yours affectionately', 

[Caboltse] 

p.S. — ^The latest craze is to pretend to be bored stiff. As a matter 
of fact, Speech Day was fun, and I tliink most of us rather enjoyed it, 
particiilarly because wo could clap so much for no reason at all. 


[I Tlie Committee are not responsible for the morals of their examinees !] 
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154. The purpose of the present investigation is plainly stated 
in the first two paragraphs of the Report : it was to ascertain 
whether by the introduction of the element of “ Sense‘” with a 
defined connotation into the marking of essays both the validity 
and the consistency of examinations on English essays could be 
improved. It must be stated equally plainly that, while the 
results of the investigation are in the view of the Sub-Committee 
interesting and valuable, that main aim has not been achieved, 
for reasons which we shall suggest. The statistical report states 
that, although the examiners themselves agreed in regarding the 
category of Sense as of great value (para. 35) these examiners do 
not show greater agreement when marking for a well-defined 
category, such as Sense, than when they mark for General 
Impression. 

155. A first method, which led the statisticians to the above 
conclusion, was the use of “ standard scores ” by which we can 
eliminate the differences, of “ standard ” or “ leniency ” between 
examiners as measxued by the mean (or average) marks, on 
the one hand, and the differences of the “ spread,” or “ standard 
deviation ” of the marks from that mean, on the other. The 
actual (and laborious) method of comparison was made by the 
drawing of 1200 “ cumulative frequency curves ” and an examina- 
tion of their characteristics (see paras. 51—58 above). 

156. These resTilts were confirmed by a second method called 
the “ Analysis of Variance,” explained in the Note on this subject, 
on p. 149. In this analysis the statistician attempts to distingmsh 
three components in each mark ; the “ absolute merit ” of the 
script, the examiner’s idiosyncrasy, and his random errors. Dr. 
Ebblewhite Srmth comes to the interesting conclusion that while 
the absolute merit has the greatest effect in determining the mark 
awarded, the combined effect of the random error and the 
idiosyncrasy of the examiner is probably greater than that of the 

. sliould bo made in this connexion to the valuable passages dealing 

English jLiterature, as %vell as to the general chapter on the 
bchool Certificate Examination, in the important report of the Spens Committee 
IKeport of the Consultative Committee on Secondaiy Education with special 
reftrence to Grammar Schools and Technical High Schools (H.M. Stationery 
Office, 1938, Ss. 6d.), pp. 218-228 and 2.54-267). 
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absolute merit for all categories except Sense and General Im- 
pression ; and that though these categories were those which were 
marked " most satisfactorily ” the effect of the absolute merit 
was [only] very slightly larger than the combined effects of the 
random error and the idiosyncrasy of the examiners — not very 
reassuring statement ; and, finally, that neither the examiners’ 
differences nor the random errors of marking are significantly 
less for directed than for nndirected essays. Since it is obviously 
easier for examiners to mark for “ Sense ” in the directed essays, 
in which object and audience are explicitly defined, than in un- 
directed essays, in which they have to be guessed by the examiner, 
it is again evident that the introduction of the element “ Sense ” 
has not had the desired effect on the marking.^ 

157. Dr. Smith, in the sections dealing with Factor Analysis 
(paras. 86-95), also investigated the marks for the various 
categories by the use of correlation-coefficients with a view to 
determining, if possible, the influence both of the various 
categories, and of the capacities tested by the objective tests, on 
the marks for General Impression. But he finds the “ factor- 
pattern ” difficult to explain. One factor only is sufficient to 
account almost entirely for the inter-correlation of all the seven 
categories. On removing this factor, a single group-factor was 
sufficient to account for the correlations between the objective 
tests (see para. 92). He came to the conclusion that the liigh 
value in all the categories was due to what is known as a “ halo ’’ 
effect, i.e., examiners when awarding a mark for other categories 
are unable to free their minds entirely from the General Im- 
pression, and their marks are really very strongly Aveighted with 
General Impression.® 

157a. Om- own general interpretation of the failure to improve 
the consistency of the marking is that the examiners, brought up 
in the old tractions of teaching and examining, in spite of their 
manifest ability and theii- desire to conform to a new method, 
were imable to free themselves from those acquired traditions. 

A careful investigation on a smaller scale by Dr. B. M. D. Cast 
has led to similar results. (See Note on p. 167 beloAV.) 

1 AVo liave not. quoted in extenso the conclusions, for -wliich referenco must be 
made to para, 85 above. 

* Attention should be drawn here to the conclusion of the Note on pp. I.o0-I, 
in wliicli it is stated that Dr. Burt and Dr. Godfrey Thomson, to whom the proofs 
of this book wore submitted, havo-independontiy suggested that a psj-ohoiogioaiiy 
more acceptable analysis would bo one which produced two factors among tho 
categories, namely a general ability factor and a “ halo " factor ; and Dr. 
Thomson has suggested a method by which tliis result might be achiovod. Dr. 
Spearman lias also mode another important suggestion with regard to this 
xoaffer. 

I 
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158. Our statisticians in their first analysis have used the terra 
‘ absolute merit ” and have implied tliat this is capable of being 
measured by numerical marks. It is a term that needs closer 
scrutiny. Dr. Rhodes, in The Marhs of Examiners, has ■vrorked 
out a method for calculating out from the actual marks the 
‘ ideal mark ” for a “ piece of work ” by the “ perfect ” examiner. 
It is based on the assumption that the average verdict of a number 
of examiners is better than any of the single verdicts. We may 
here recall the postulate by Professor F. Y. Edgeworth in his 
pioneering work on the statistics of examinations that the true 
or standard mark for any piece of work is the average of the 
marks given by a large number of competent examiners equally 
proficient in the subject and instructed as to the character and 
purpose of the examination. Edgeworth clearly stated that he 
regarded this as a postulate and not an axiom, and expressly 
noted that his subject was not the philosophy of examinations. 
(See the Journal of the Statistical Socieiy, vol. li, pp. 599-635 (1888) 
and vol. liii, pp. 460-475 and 644-663 (1890) ). As one of us 
pointed out in a previous publication {Examinations and their 
Relation to Cxdture and Efficiency) (1918, p. 103), the weakness 
of the postulate for practical use is the absence from most 
examinations of any clear definition of pinpose. 

para. 369) remarks (in the language, 
perhaps,^ of understatement) that one examiner’s idea of “ per- 
fection may be different from that of another examiner, and 
he attempted to calculate “ ideal marks ” from a mathematical 
treatment of the marks actually allotted. Underlying the state- 
mmts both of Edgeworth and of Rhodes there are fimdamental 
difficulties whicb we must now approach. 

convenient to approach them by considering the 
X^oblem of making some very simple test in a subject less complex 
than that of English composition, one in which all examiners, 
without instructions from any examining body, but using 
ymvoraally adopted conventions, must necessarily agree as to the 
^rfect answer.” The simplest possible example is perhaps a 
e ^ m simple addition ; yet even in such a test we shall find that 
aasy to encounter at an early stage possible and legitimate 
^erences of opinion as to how the answers should be marked. 

or it we test only the addition of simple digits of which the 
sum amounts to mop than 9, we shaU have to decide whether 
any answer containing one right and one wrong digit should 
receive any marks or none. And as we complicate the sums in 
antUmefac it is only by a complex and rigid system of conventions, 
on w ich different experts and examining bodies may' easily 
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take^ different views, that we can secure any approximation to 
consistency in the marking of the scripts. ^ 

161. A difficulty of another and serious land arises, affecting 
other examinations besides those in arithmetic, if we follow a 
common practice and introduce a non-arithmetical element, such 
as “ neatness,” into the marking scheme. It leads at once to an 
equation such as the following, 

5 marks for neatness = 5 marks for accuracy, 
though the maxima prescribed for the two categories ma 3 ’^ be very 
different. W^e do not challenge the desirabihty of giving marks 
for neatness in marking arithmetic scripts, but we suggest that 
if the result is not to be misleading tliey sliould be kept distinct 
from first to last from marks for accuracj'^ in arithmetic. There 
can be no rational method of equating the two kinds of marks 
and the sum of such heterogeneous quantities has no rational 
meaning. We shall find the same land of difficult^', together 
with fresh ones, in the marking of English compositions, to which 
we now return. 

162. We begin by quoting a passage written some time ago 
b}’' one of the members of oim Sub-Committee. “ An essay (said 
Dr. Ballard) is an intricate mental product which can be analysed 
in a varietj’- of ways and yet can never be anatysed completely. 
Each examiner consciously or unconsciously (as a rule uncon- 
sciousty) makes his own analysis, measures each element by liis 
own rod, weighs each factor in accordance with his own scale of 
values, and finally arrives at a verdict which sums up a number 
of hazy personal impressions.”* 

To diminish the “ haziness ” of such categories of impressions 
it is common for examining bodies to classify them beforehand 
and to define for the several examiners the maximum marks 
which thej" are to allot to each categorj'-, with a view to reducing 
the differences in the marking by different examiners. The 
results recorded in The Marks of Examiners amply demonstrate 
the insufficiencies of the method ; but for the moment we are 
considering not so much the question of the inconsistencies of the 
method ak of its validity. 

163. In the first of om: own investigations recorded in The 
Marks of Examiners on essays the system adopted followed 
exactly or almost exactly the scheme for a Special Place e.xamina- 

* For oxomples of inconsistencies in tho marking of scripts in .simple 
aritlunotio rco An Examination of Examinations (ptyos. 30-38) and Tne Marls 
of Examiners (pp. GS-116). The designers of “ objective tests” in arithmetic 
Iinve used gre.st ingenuity to sunnoiinf the difRcultics but are limited in the tj-pi" 
of questions that they can set. 

’ The. Xcw Examiner, by P. B. Ballard (Hodder J: Stoughton, ."itli impression, 
1929), p. 62. 
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tion prescribed by the authority Avhich furnished us \rith the 
scripts. The categories, ivith the maximum allotted to each and 
the (hypothetical) marks of two candidates who would have been 
treated as of equal “ merit ” at their scholarship examination, are 
set out in the scheme below. 


Categories^ 

Maodmum 

Makes 

Awarded to 
Script A 

Vocabulary 

7 

1 

Accuracy 

7 

3 

Craftsmanship 

7 

5 

Consistency 

7 

7 

Completeness 

7 

1 

Substance 

7 

3 

Quality 

7 

5 


Aioarded to 
Script B 
5 
3 
1 
7 
5 
3 
1 


25 25 

Without further analysis of detail we may ask : Is it possible to 
attach any rational meaning to the conclusion that two such scripts 
should be regarded as equal in “ merit ” ? It seems doubtful. 

164. But let us now take a scheme used in a second investigation 
on another set of Special Place examination scripts, with categories 
more clearly distinguished, which in our view was more satis- 
factory in its constniction than the earlier one,® and consider 
again the comparison of two scripts to which equal marks, 
amoimting to 60%, might have been awarded in different ways. 

Makes 


Categories 
Quantity, quality 
and control of ideas 
Vocabulary 
Grammar and 
Punctuation 
Structure of sentences 
Spelling 
Handwriting 



Awarded to 

Awarded to 

Maximum 

Script A 

Script B 

50 

23 

38 

15 

12 

7 

15 

10 

4 

10 

5 

‘ 6 • 

5 

5 

3 

5 

5 

2 

— 


- 

100 

60 

60 


* Examiners, paras. 172-193. 

meanings to be attached to the categories are more 
Closely mdieated m the Instructions for Examiners given in the book quoted, 

*See The Marks of Examiners, p, 118. 
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Candidate B is clearly regarded as superior in ideas, A in irhat is 
sometimes called the “ mechanics ” of composition. But what 
does the equation of the marks mean ? To equate 5 marks for 
“ quantity, quality and control of ideas ” to 2 for spelling + 3 
for handwriting, though it is more satisfactoi^’^ than the khid of 
equation quoted above, is only a sacrifice to a customary con- 
vention in this kind of examination. 

165. We suggest that we should eliminate (for entirely separate 
marking, if thought desirable) those elements of spelling and 
handwriting which would disappear if the composition, were 
delivered, or read aloud, and of which no account should he 
taken in judging its intellectual or artistic value. To equate 
marks for entirely heterogeneous elements like spelling or hand- 
■\vriting with marlvs for elements like “ Sense ” or even Sentence 
Structure is, in our view, an absurdity.^ Revolutionary as it 
may seem, we suggest that marks for spelling and legibility of 
handwriting should at no stage be added to or subtracted from 
marks for the other elements of a written composition. If the 
marks are high, they should not be allowed to compensate for 
deficiencies in other elements of the composition ; if they are low 
they shoidd not be allowed to detract from the valuation of its 
intellectual qualities. They may be of great importance ; if that 
is so, it shoidd not he beneath the dignity of an examining body 
to state them definitely on its certificate for the benefit of a 
prospective employer to whom they may be of use. 

166. We come to the more delicate and difBcult subject of 
punctuation, that rough translation to the eye of the pauses, and 
indeed also the variations of pitch, intensity, and tone, those 
natural and mainly unconscious devices by which the speaker 
marshals his utterances so as to convey immistakably his thought 
and his feelings to the listener. It represents to the eye one of 
the most essential elements for the comprehension of organised 
speech. We may hope to persuade examiners to eliminate from 
their marking for General Impression the consideration of mistakes 
in spelling and inelegances of calli^phy. It would, we believe, be 
impossible to elinnnate from their judgments the delays and im- 
certainties of understanding produced by defects in punctuation. 

> Spelling cnn be marked far more effectively by objective methods plan in a 
composition. Many of the mistakes made in writing a composition at high sjiecd 
in a^somination-room may bo due to mere mad\-ertence. 

Tlie inspection of a vexv latgo number of the thousands of essays submitted 
to us revealed the interesting fact that nearly 100% of them ivere piertypy 
lerible and legibilitv is tho sole point to be considered in judging the handwriting 
of an ^y. Any classification according to “ merit ” of pupils so nearly equal 
would bo slieer waste of time. 
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We believe, nevertheless, that objective tests in spelling such as 
the^ one -we have used, ■will yield more consistent results than any 
incidental marks awarded in the judgment of a composition.^ 

167. We return to the actual categories "which were settled at 
the beginning of our work, after discussion by the experienced 
examiners who took part in the investigation, as those that they 
■wished to take into consideration in the marking, -viz. (I) Sense, 

(H) Spelling, (in) Punctuation, including Formal Paragraphing, 
(IV) Grammar, (V) Vocabulary, (VI) Sentence Structure and 
■ ^to be marked last — (Vii) General Impression (see para. 28 
above). We exclude here the category of Literacy, which is not 
of a parity with the others and which we discuss later (see para. 
180 below). 

We deal first "with categories (II) to (VI). Tables (H) (1) to 
(II) (6), (pp. 24—29) and the Tables for the Re-marldng, XVII 

(I) to XVIl (6) (pp. 61-66) show the considerable discrepancies 

that occurred in the marking for these categories. The two 
categories regarded as of the greatest importance were “ Sense ” 
and “ General Impression,” and these were marked, "with 
intention, first and last : Sense first, because we "wished to avoid 
concentration on details in judging whether a composition 
fulfilled its object or not, whether it “ succeeded ” or “ failed ” ^ ; 
General Impression last, because we "wished the examiners to bear 
m mind, though ■without using the process of addition, all the 
factors which had contributed to that General Impression (see 
para. 35). But we pi^osely refrained from asldng the examiners 
to give any long consideration to categories II to VI which would 
^ti^ expenditrue of time out of proportion to its 


We defined at the beginning of this Report (paras. 1—6) the 
^eaal connotation which we have attributed to the word Sense 
m the marking of compositions, and we believe that when the 
prmciple of demanding Sense in the marldng of a composition 
has been more videly adopted in the class-room, it iviU be more 
ea^ to adopt it in the examination-room. 

t may be noted here incidentally that the examiners definitely 
renounced the idea of giving as a final mark for General Im- 
pression the sum of marks given to the other categories and thus 

at Good authority that, aomo years ago, specialist examiners 

a hM^a nA, proposed to disqualify a candidate for the gold medal in 

Tlipir examination becauso ho began many of liis lines with commas, 

womo sold medallists had committed far 

specinlista relented. 

f ion of fViiiIrliUa' c onts5d of this Report, as an extreme cage, an necumiila- 

nraceumu was nonsense. Wo may have 

accumulation of faulty scriteaccs of which the resultant is o.xcolicnt sense. 
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avoided the equations of heterogeneous quantities criticised 


above. 

168. The examiners finally' recommended the modified set of 
categories quoted in para. 35 a above, viz. (i) Sense, (ii) Spelling, 
(iii) Punctuation (including Formal Paragraphing), (iv) Grammar 
and Syntax, (v) Accuracy of Vocabulary (the exammer bearing 
7 ^^ 7 Tid only "whether the "words are used correctly or incorrectly), 
(vi) Po-wer of Expression, to cover (a) felicities of vocabulary and 
(6) Sentence Structure, (vii) General Impression. This new list 
of categories, based on the experience gained in the investigation, 
seems likely to be an improvement on the previous one, especially 
in three respects : the union of Grammar and Syntax ; the intro- 
duction of the term Accuracy of Vocabulary, restricting marking 
under this heading solely to the question whether w'ords are used 
correctly or incorrectly ; and the introduction of the term Pow'er 

of Expression, etc. j-xr ^ i 

On two points to which we now tiun we differ from the proposals 


of the examiners. o • x. i r x-u 

169 (i) The examiners recommended an S-pomt scale tor the 

marlun^ of categories (iii), (iv) and (v). We do not object to 
the scale being less extended than for the other categories. But 
Sere are decided advantages in a scale ivith a mid^e or “ median ” 
noint and we therefore should prefer a 9-pomt scale if the 15-pomt 
scale is abandoned. It is convenient to make the mechan pomt 
correspond either to an average mark, or, as we have done, to a 

competency mark^^^g English schools to 

insist on the use of a plan, and the fafiure of exan^ers to demand 
it the attempt to persuade our exammers to mark for Plan failed 
fsee naras 30 and 34 above), we attach grea.t importance to its 
t amon<r the categories. We regard the general omission 

S the Plan from the teaching of the mother-tongue m most of 
one of the most serious defects m our educational 
it i toe that the .ovice may tod it diffiealt to think 
S and plan a composition before he begins to amte. But any 
Srcan be taucrht to make a summary of what he has written, 
^SritT^L hL compori^^^^ in the light of his owm summary 
ind if necessary, to re-write it. A few of our scripts show that 
and it ne - ^ A jn use by some teachers, 

this jneft d recommended by the esaminets 

end by oto*el are of tno hinds, those to n-hioh nmyetsally 

« b..p. a. . 
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accepted conventions apply, and the rest. The spelling of a 
composition may be “ perfect ” and have therefore “ absolute 
merit.” That is more or less true of its punctuation and formal 
paragraphing, its grammar and S5mtax, the accuracy of its use of 
vocabulary and its sentence structure. But it is tmtrue of a plan, 
still more untrue of “ power of expression, covering felicities of 
vocabulary.” What one examiner regards as felicitous, another, 
with equal justification, may regard as unfortunate. We are 
launched by that phrase on a sea of uncertainties, the uncertainties 
of msthetic judgments, in which the ierra jirma of “ absolute 
merit^ may be undiscoverable. It should be the business of the 
examining authorities to make sure that no candidate at a School 
Certificate examination is wrecked on that sea.^ 


1 / 1. Now imcertainties appear to be no less -conspicuous in the 
marking of French compositions by French examiners. In in- 
vestigations carried out by our colleagues in France, the Com- 
inissionfran^aisepour VEnquete Carnegie, three essay-scripts {copies 
de composition francaise) which had each been awarded 36 marks 
out of 80 (or 45 per cent.) and had been ranked as 24th out of a 
batch of 50 at a baccalaxiriat examination were re-marked in- 
dependently by 76 examiners. The marks for one script varied 
from 4 to 52, for the second from 12 to 64, for the third 
from 16 to 56, out of a maximum of 80. The mean marks for 
the three scripts were 25-9%, 40%, and 34-4%. In another inves- 
gation on 100 scripts in French composition presented at the 
accalaureat, which were marked by 5 examiners (in addition to 
e one who had marked at the actual examination), 20‘1 per 
cen . of the total number of differences befrsveen examiners 
exceeded 25 per cent, of the maximum marks ; and 70 per cent, 
r n ^ were marked as “ passes ” by some examiners and 

lauures by others. = We suggest that with variations of this kind. 


m^ersi^ schol^hip examination of a group of colleges at a 

Class anei'uixr lenient of the five examiners placed in the Fourth 

Second - and °°° ‘=°5®“g“e.P}nced in the First and the other three in the 

the award of tTi-i other striking discrepancies of judgment, especially in 

= nn 7?^ of Examiners, pp. lls ei seg% 

Committee’ under massive volume published by the French 

President, 31. Auguste Desclos :-£« 

Baccdlaureat Ola^nn el T Examens, Enquite expirimentale sur It 

du Li\’re. Paris. IMfi rm.-! 


CoTTeciion President, 31. Augusto r>escIos Xa 

Baccdlaureat Ola^nn el T Examens, Enquete expirimentale sur It 

elabomMo^TtatLte^H^"^ PP' 'P^ volume cental 

mnrt-ir... =“ti^ical and general, by distinmiished snecialists. on the 


examination in Fmn^v. . ^^^^®^^^s^^Becondpartsoftbo 6 acca 2 awr/at 

ma^attes, phvSS?fnd"S^r’ (unseen), English, 

are given in another mibliVnC of the baccaUiuriat examination 

to the School Certificate and Higher 
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and of those shown by our own investigation, tlio mean marks 
of a largo^ number of examiners desiderated by Edgeworth have 
no real significance. The examiners are obviously evaluating 
different elements in the compositions. 

172. But if candidates ought not to be ploughed by chance, 
neither ought they to be passed by chance. It is obviously the 
business of the examining authorities to see that a “ pass ” in 
English at the School Certificate stage means the possession of a 
utilisable skill in the use of the mother-tongue, and that it is not 
liable to bo the farce condemned by the Investigators of 1931. 

Some of the difficulties in this matter, too complex to be 
discussed fuU}'^ in this place, are created for examining bodies 
in part by their own regulations.^ But we think it would be 
reasonable that the candidate who has passed in other subjects, 
but not in English, should not be required to pass in those other 
subjects again, but allowed an increased portion of his time to 
enable him to malce good the deficiencies in a sldll likely to be 
of major importance for his future career. Does not the require- 
ment to pass a second time in a subject in which a candidate has 
passed alread}' cast a doubt on the efficiency of the examination -? 
No one would think it reasonable to require a pupil who had 
obtained a certificate for smmming 100 yards to undergo the 
same test a second time merely because he had failed in (say) a 
horse-riding test on the same occasion. 

173. The examination of essays in the form in universal vogue 
until recentlj' at School Certificate examinations has been 
criticised by members of our Sub-Committee on various occasions 
and for various reasons, of which one was its unreliability. “ The 
examiner’s bhmders,” uTote Dr. Ballard, “ are as carefully 
hidden from the public gaze as the doctor’s blunders under the 
tombstones.”- But one e.xamination authority, the University 
of Durliam, during the early days of our omi investigations on 
examinations had the courage to reveal tlie glaring inconsistencies 
of marlung in English at the School Certificate stage.=* Although 
the Investigators of 1931 were obviously imaware of the in- 
consistencies of marlung to which the University of Durham drew 

» For a fullor discussion of these difficulties see the chapter on English Com- 
position at the School Certificate E.\amination in the Essays on Examinations 
pubUshocl by our Coraraitteo (pp. 131-42) and the address by Sir P. Hnrtog on 
Secondary School Examinations . . . tcith svggestions for Eeform (published by 
the National Union of Teachers, 1937), especially pp. 17-25, including a summary 
of the scheme of Dr. IV. Edwards, sometime H.jl. In.‘ 5 )cetor of Schools. 

= See The New Examiner, p. 05. , 

’ Seo The Marks of Examiners, pp. 64-67 ; and {lapers by Jlr. C. Roberts and 
Professor H. V. A. Briscoe, (then) of the University of Durham, published in ' 

4 M.A. (the organ of the Assistant Masters’ Association) for December, 1931, 
and February and March, 1932, and in the Journal of Education for April, 1932. 
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attention they had detected other grave imperfections in the 
exammations in English to which the pubUc became alive ; and 
he Board of Education has recently induced the other seven 
Certificate authorities to follow the example that had been 
se by the Joint Matriculation Board of the Northern Universities, 
and to make a pass in English (apart from English literature) 
compulsory a,t their School Certificate examinations J 
• + j their new regulations the examining authorities liave 
m reduced certain reforms for wliich the public must be grateful, 
r + 1 ? • precise effect cannot yet be judged. The errors 

Ox eir examiners may still be concealed under the tombstones 

0 Twong rejections and the monuments of Avrong jiasses. 

1 . -b irst and foremost of the reforms are the separation of the 
exammation in English language from the examination in English 

era me and the rendering of a pass in English compulsory, 
e erred to above. Secondly, there has been, in om judgment, 
a marked all-round improvement in the detailed questions on 
ng sh m the papers other than those which include the “ essay ” 
or I S equivalent. Some papers, though not all, include the 
write a letter mth a definite object in view.® 

_ nirmy , a number of the authorities have abandoned the use 

oxamination papers of the word “ essay ” with its 
schoolboys and schoolmasters alike 
a Goldsmith or an Addison), crystallised in John- 
son s defimtion of the essay as “ an irregular, ill-digested piece.”® 

be a mistake to imagine that the old 
vflcf ni" pupils of 15 to 16 to write compositions on 

thp both) for the world at large has diecf 

1939 anH iQ^n Here is a list of some subjects set in 

1939 and 1940 at School Certificate examinations 

,• The North Sea. 

Cathedrals. Pockets. 

Poland. 

Readmg. Beasts of Bmden. 

Sunday. 

Wanderers. Money. 

^ See the f Marvels of the Sky. 

Board on p. SO^above ^ and Investigators and the action of the 

= The follorving is aA example Examinations, pp. 131-142. 

(of about 100 words) to a raUwat ee ^ 1"®®Uon actually set “ Write a letter 
m advance,’ to the place where complaining that your luggage, sent 

you and is already two davs late pending a holiday, has not reached 

not a letter of this Icind (nerhans “V necessary particulars.” Why should 

English teat ? It would have a? i°?Ser) be regularly sot as part of the 

° Quoted in the Shortdr Oxford Dirt^onniy^'^°°°^ class-room. 
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Imafane the difficulty of equating the merits of an essay on Poland 
■with” those of one on Pockets or Sunday. The tradition of the 
“ Hi-digested ” piece stares one in the face. We Imow -ahat to 
expect from most schoolboj’s or schoolgirls asked to -write on 
such topics in the time allowed in the examination-room. It is 
onlv fair to say that many of the other subjects are on a different 
level and seem to us to show a greater degree of common-sense 

in their selection. . 

17G. The time allowed for the essay or its eqmvalent is not 
always exactly specified— but in the regulations in which it is 
actually specified it varies from three-quarters of an hour to an 

hour and a quarter. - . i , 

177. One authority is obviously anxious to reduce that tune 
to a minimum. In an essay-paper it gives the following in- 


“ Remember that regard wHl be paid chiefly to soundness of 
style and suitability of material, and not to raere length. A 
<Tood composition of a page and a half, in handwriting of average 
Sze will be sufficient to earn a high mark, and your composition 
must not exceed three pages in length.” 

Obviously the authority regards a serious test of the power of 
composition and literary construction as not to be thought of 
in its examination, probably in view of the imcertainties of the 
results Nevertlieless the terms soundness of style” and 
“ suitability of material ” may seem to need some fmther elucida- 
tion. A style that might be sound and the material that might 
be suitable -with one kind of auffience and object in -new might 
be no less unsound and unsuitable for another. It is needless to 
enlarge on this criticism which raises agam the general problem 
of purpose in ■writing. 

178 Tivo reforms in the tests of English composition besides 
those already suggested might be usefffi at the present day. The 
Board of Education, through its Secondary Schools Examinations 
Council, might request the exa^ation authorities to furnish 
them with specimens (chosen bj the Coimcil from the sole in- 
spection of the numbers and marks of the candidates) of English 
scripts to which the borderhne mwk (o) for a pass and (6) for a 
creffit have been assigned , and some of th^e specimens might be 
Stimately published for the mformation of the puty,. ° 

Further, tlie Board mig i v authorities to test the con- 
cistency of marking of their o-nn exaiumers by requirincr them 
W S«k .t the end of he — eflon, „j., f 
scripts tbnt they hnd stance, aU indieatiow 

of the numbers and first markm^s of the scripts having 
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remoy^ (as was done in re-marking at the present investigation) ; 
and information on the results of these tests should be trans- 
mitted to the Board. All concerned would then know more of the 
accuracy of the methods on which the fate of so many candidates 
depends. We have reason to believe that tests of this kind have 
been made by more than one authority. But the results have 
not Jieen revealed to the public. 

179. We venture, not without hesitation, to make one still 
mm^ ^astic proposal. It is that the lengthy composition, so 
dimcult to ]udge fairly in the examination-room, be temporarily 
^^tos^ther from the School Certificate examinations. 
Ihe objection is obvious, that this fundamentally important 
means of sttoulating both creation and criticism, if properly 
use , might disappear from the schools, with unfortunate results, 
inere may, however, be a way out, namely, that the Board of 
Hiducation should lay down conditions in its rules for grants 
reqi^g that a sufficient amount of time should be devoted 
ae ^bject ; and we might trust to teachers and inspectors 
see that this time was properly used. The composition would 
replace the essay ; the consistency of tests in English would be 
^ ® ®^^iidnation-room ; and we may hope that the 

emciency of the teaching would be increased in the school. 


180. As a postscript to the summary given in the preceding 
^ abstract of the chapter on Literacy, 
of 70 S 1 that the report of the Government Investigators 

though not in so many words, that the term 
a touchstone to distinguish between 
‘liose who should be 
S the School Certificate examination.^ 

pro4^ ^oped that it might 

maZ f^aed us. The variations of the 

stacre School Certificate 

recoeni'e?H, ^T,^^®-“i' meaning sufficiently clear and well- 
judoinff thp of examiners to be used effectively in 

SOO^scrints ^ candidates. At the first marking of the 
examiners Thp divergencies between the different 

SSS fb. re-marking repeated and em- 

?xSL Showed that the 

greed not only with each other but with themselves. 

Sg€ P* 80 f 17. 

examinations has b^n numpa Wnd on School Certificate 

School Certificate examinatfnri ^ pr^at, although a report on the Higher 

e exammation was rssued in 1937 (see footnote on p. 154 below). 
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In the re-marking of the 120 scripts they changed their own 
verdicts in 159 cases altogether out of 960, or one in six. 

Thoiigh our hopes were not realised the results of the tests 
had a certain interest. They show the degree of attainment 
reached by certain pupils whom the great majority of examiners 
regarded as iUiterate. On p. 88 we have reprinted in extenso an 
essay by candidate No. 43, the only essay out of the 600 regarded 
by all the eight examiners as illiterate. It shows that the author 
has ideas, and can use words so as to convey them to other people. 
He is the master of a fair vocabulary and his spelling mistakes 
are neither numerous nor really misleading. His punctuation 
(including formal paragraphing), grammar, and sentence structure 
leave much to be desired. But he Imows what he means ; and 
with good teaching he should be capable within a reasonable 
time of writing correct English and of expressing himself ■with 
some force. He is unlilrely to become (we quote his own amusing 
phrase) a “ cosin ” (he means cousin) to a clam. 

In what precedes, we have pleaded that a candidate who has 
failed in Enghsh but passed m other subjects (for which a 
laiowledge of new " periods ” or new “ special books ” might 
be required), were he to take the examination again, should be 
excused those subjects so as to enable him to devote more time 
to the mother-tongue. The case of a candidate -with a standard 
in English comparable to that of No. 43 illustrates our point. 



CHAPTER VIII.— smniAPvY OF RECOJDIENDATIONS 


181. With a view to the improvement of the teaching of 
the mother-tongue in our schools and the examinations in this 
subject which at present so vitally affect tlie teaching, we make 
the following recommendations : — 

(1) That the practice of asking pupils from the age of 13 
and upwards to write “ compositions ” termed “ essays ” be 
abandoned ; and that they be asked instead to write compositions 
on subjects about which they may reasonably be expected to 
have a fund of ideas and a sufiRcient knowledge which they conld 
express for a given audience and with a given object in view , 
and that before the writing is actually begun the audience and 
the object be either defined by the teacher or the examiner con- 
cerned, or left to the pupil himself to determine. (See Chapter 
I and passim.) 


(2) That in order to teach the pupils how to present their 
thoughts in orderly sequence they be required when writing a 
composition of any considerable length to submit with it a short 
plan or summary. (See para. 169.) 

(3) That teachers and examiners be advised to judge a com- 
position in the first instance for its “ sense,” basing their judgment 
on their •estimate of the degree of success of the writer in the 
attainment of his object, and bearing in mind that while an 
accumulation of perfect sentences may make nonsense, an 
accumulation of sentences by no means impeccable may make 
excellent sense. (See Chapter I and passim.) 

(4) That compositions of pupils of, say, jhom 13-16, be marked 

rTTl q categories, in the order indicated : (I) Sense ; 

/TUX Fnnctuation, including Formal Paragraphing ; 

fiV) Grrammar and Syntax ; (V) Accuracy of Vocabulary (the 
on y pomt taken into consideration being the correct or incorrect 
use Of words) ; (VI) Power of Expression, to cover (a) felicities 

m e use o vocabulary and (6) sentence structure ; and (VH) 
tieneral Impression 
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And ihat the mark for General Impression he allotted after 
the marks for the other categories, but not by any process of 
arithmetical summation of those marks. (See paras. 161-8.) 

(5) That marks for such categories as spelling and legibility of 
handTsnting be neither added to nor subtracted firom marks for 
any other category ; but that, when importance is attached to 
them, such marks be recorded separately on any certificate given 
to the pupil or issued to the public. (See paras. 161-5.) 

(6) That provision be made in the curriculum of schools for 
exercises to be set, say once a fortnight, for the writing of a 
composition of a length which will reqm're not less than 2 (or 2h) 
hours’ work (including time for corrections and re-copying, if 
necessary) ; and that notice of the subjects of such compositions 
be given to the pupils, as a general rule, a week or ten days 
beforehand. 

(7) That the authorities for School Certificate examinations 
be invited {a) to test the self-consistency of their examiners by 
requesting them at the end of an examination to re-mark, say, 
25 or 50 of the scripts which they had marked originally, all 
marks on those scripts (including the original numbers) having 
been removed ; or, as an alternative, that they be asked to mark 
typed copies of the originals (see paras. 97-105) ; (6) to test the 
general consistency of the marking of the different examiners 
by assigning to them at the end of an examination for re-marking 
a set of 25 or 50 typed copies of the original scripts ; and that 
one or more sets of scripts be assembled for this pmpose, each 
set being composed of scripts which had been originally assigned 
to a number of different examiners. (See para. 178.^) 

(8) That in order to test the real significance of the awards, 
such as Pass, Credit, etc., for English Composition given by 
School Certificate Examination authorities each such authority 
be requested to submit, at intervals to be determined, for the 
information of the Board of Education, through the Secondary 
Schools Examination Cormcil six specimens of ’ compositions to 
which the borderline mark for each of such awards has been 
finally assigned; and that such scripts be selected by the 
Secondary Schools Examination Council by the inspection not 
of the scripts but of a numbered list of the candidates to whom 
borderline marks have been allotted. (See para. 178.) 

(9) That, for a period to be determined, the demand to write 
a composition exceeding (say) 200 words in length be omitted 

* This Recommendation is mainly based on tho general statistics recorded in this book 
ns a M-hole ; see also The Marks of Hzatmners, paras. C62 and 609. 
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from School Certificate examinations ; and that this restriction 
should not involve a corresponding restriction in the teaching 
of Enghsh composition, which should always have ample time 
defimtely allotted to it in the school time-table, distinct from that 
allotted to other branches of English, such as grammar and 
literature. (See para. 179.) 

(10) That in School Certificate examinations the use of precis 
he extended to passages of not less than 1000 words ; and that 
the candidates be required to make a precis of such passages not 
exceeding one-sixth of the length of the original ; and further 
that the object of the precis be defined as a statement of what the 
candidate regards as the main points in the original passage for the 
benefit of a person who has not the time or opportunity to read 
that passage for himself. 

(11) That at the School Certificate examinations no candidate 
who has failed in English, but has passed (or obtained credit) in 
other subjects, be required to re-present himself for re-examination 
in such other subjects, and that if a candidate has passed (or 
obtained credit) in English he be not required to re-present 
himself in that subject. (See para. 172.) 



NOTE ON THE ALLOTMENT OF THE COMPETENCY 
]\IAE.K IN THE MARKING FOR GENERAL IMPRESSION, 
AND ON THE RANGES OP THE MAR KS IN THAT 

CATEGORY 

1. In the Note on Certain Points in the Marking of Examiners 
(pp. 152-165 below) we draw attention to the fact tliat the “fixed 
point ” from which the marking starts is 50 per cent, in some 
important examinations designed to test ntilisable s kills 

2. In the investigation on College Entrance Scholarship Essays, 
recorded in The Marks of Examiners (pp. 142-147), in which 50 
scripts were marked independently by five examiners, the im- 
portant or fixed point for consideration was the limit for a First 
Class for which the prescribed mark was 07 out of a ma.ximum 
of 100. Blit an examiner was permitted, if he so preferred, to 
mark first for classes and then to arrange Ids marks to fit his 
classification ; while if he preferred to mark first numerically 
he could arrange his classification to fit Ids marks. The dis- 
crepancies between the different examiners were great, both in 
the number of awards of First Classes, and in the selection of 
candidates for such awards. Though the average marks for the 
different examiners only varied from 60-6 to 54-8, the number of 
First Classes allotted by them varied from 2 to 8. Not a single 
candidate was placed in the First Class by more than three of 
the five exandners, and only three candidates received three votes 
each for a Fii-st ; four received two votes each ; and ten had 
one vote each. 

The range (i.e. the difference between the highest and lowest 
marks awarded to any candidate) varied from 7 to 35, with an 
average of 20, for the whole set of scripts. 

3. In the present investigation the important diiiding line for 
consideration is not a “ First Class mark ” but the “ competency ” 
mark, (8) with a fifteen-point scale. If we could have found 
any general agreement in the allotment of the comiietcncy mark 
it would have been of real use ; wo should have taken a definite 
step in advance towards a satisfactor 5 ' method of decich'ng which 
candidates should pass, and which should fail in English com- 
position at a School Certificate examination. But Tables XXIX 
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an below, wliieh give the percentages of marks of eight, 

ancl or marks above eight and below eight, for each examiner and 
eac essay-subject, both at the first marldng of the 600 
es^ys, and at the re-marldng of 120 of them, show that the 
the different examiners at both markings, 
an the difference between their individual judgments on the two 
occasions, were great. 

4. The percentages of the limiting mark for competency for the 

^ vary only from 19'1 to 21 -8, 
™e the percentages for the other three examiners, T, U, and 
• 17-5. How far this is due to mere chance 

+1 tS- ^ determine ; but it is clear from the inspection of 

figures for the different essay-subjects 
a ere is no kind of constant agreement as to which particular 
scnpts are on the borderline of competency. The differences 
re ma e further apparent when w'e classify the examiners 

ceor g o their percentages of 8 marks and over, which are 
as loilows ; — 

.0 . ^ s T u V W 

78-4 57-6 61*4 45-6 77*0 ' 62-0 62-7, 


Sd ?n T), (R, S, V, and VS^) 

matilw +h ^ different from the groups who allot approxi- 

mately the same percentage of borderline marks. 

s ^Mowing table summarises the percentages of marks of 
I marks of 8 and over, allotted at the two markings : — 


CoOTABlSOK OF PebCENTAQES OF CoMPETENOy 
AIabks fob Fibst and Second Maekings 


Percentages of the mark for Competency (8) 



p 

Q 

B 

S 

T 

U 

V 

W 

5’irst Marking 
Second Marking 

.. 19-7 
.. 23-3 

19-1 

30-0 

20-8 

20-0 

21-2 

36-7 

11-0 

15-8 

14-0 

22-5 

21-8 

16-8 

17-5 

16-7 

Examiner 

Percentages 
P Q 

of Marks of 8 and over 
B S T 

U 

V 

W 

First Marking 
Second Marking 

. 49-4 
. 51-6 

78-4 

82-5 

S7-6 

42-5 

61-4: 

75-0 

45-7 

'84-1 

77-0 

79-2 

62-0 

81-6 

62-7 

62-6 



PEROENTAaEft OV BOBtPTS WmOU BEOBIVED THE MARE 




FmcmTAOJcs or scniras mtion bkoeived the jrARK or oompetenoy (8), or a nroirsK JtAKK (8 + ) and of a 
I.OB'E n MAJIK (8 — ) IN the EE-lVrAIlKINa FOB GENERAL IMPRESSION. (120 SORIPTS) 



NOTE ON THE ANALYSIS OF VAHIANCE AND 
FACTOR ANALYSIS 

[Some additional explanation of the subjects named in the heading 
seemed to be desirable for the non -statistical reader. The following has 
been dravrn up as a result of consultations with foiu* members of the 
main Committee, Professors Burt, Hamley, Spearman and Godfrey 
Thomson. It is regretted that owing to his absence in Canada it wns 
impossible to submit the text of this note to Dr. Ebblewhite Smith for 
his comments.] 

Our results have been analysed by two mathematical 
methods : — ^The Analysis of Variance (see paras. 59-85 above) 
and Factor Analysis (see paras. 86-95 above). The two 
methods, as applied to investigations of this kind, may be briefly 
distinguished as follows : — 

The, Analysis of Variance, in the simple form in which it is 
here used, is a method of analj'sing the variation of the marks 
awarded b 3 ’ a number of examiners to a number of testees on the ,, 
results of a single test of abilitj’, in order to determine how much 
of that variation is due (1) to the differences between the testees, 
(2) to the differences between the examiners, and (3) to random 
or chance errors. 

Factor Anal 5 '-sis as most commonly used may be described as 
a method of analysing the marks allotted to a number of testees 
not on a single test, but on a number of tests of different kinds, 
into different components, so as to show whether two or more 
of the tests have one or more common factors. The interpretation 
of the nature of the common factor or factors is left to the person 
making the analysis and may be made in different ways by 
different investigators. The mathematical analj'sis itself tells us 
nothing about the -nature of the factors. 

For example : A factor analysis of examination-marks awarded 
to the same candidates in Latin, French, Music and Art, would 
probably show a common factor, strong in Latin and French, 
and weaker in Music and Art. This could be interpreted as 
“abstract intelh'gence.” It might also show a group-factor 
involving Latin and French, and another group-factor involving 
Music and Art. The firet of these could be interpreted as a 
“ verbal ability ” factor and the second as an “ {esthetic ability ” 
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factor. These interpretations are highly subjective, and alternative 
factor-analyses which explain the data equally weU can be made 
and may be preferred by another experimenter. What we can 
be sure about are certain relationships which the mathematical 
must in all cases hold between the factors. 

The distinction between the analysis of variance and factor- 
analj’^sis is not, however, as sharp as may be suggested by the 
above first accoxmt. Each of the above situations may indeed 
e examined by either method, as becomes at once apparent if 
we think of the examiners of the first situation as being, as it 
were, so many different “ tests ” come to fife : and “ factors ” 
can then be found among the examiners, just as in the second 
situation among the tests. Moreover, although the analysis of 
VOTance and factor-analysis were different in their origins and 
their mathematical methods, they are not' unconnected, 
an his connection is more in evidence when to the analysis of 
variance, u hich analyses the sum of the squares of the deviations 
m one test, is added the analysis of co-variance, which analyses 
e sim of the products of the deviations in two tests. It is 
esira le that both the analysis of variance, and factor analysis, 
s 0 ^ be used, as here. For the analysis of variance and co- 
variance ^ more concerned with the fundamental question whether 
exist any significant differences at all (as for example 
e een examiners, or between candidates) ; whereas factor- 
ana ysiSj the preliminary fundamental question having been 
nswCTe m the affirmative, seeks to set up a hypothetical 

differences. 

■OTfii ^ Thomson have independently suggested, 

a analysis in paras. 92-95 of the text, that 

ogicaUy more acceptable analysis would be one which 
abiliiv fa factors among the categories, namely a general 
^ 3)r. Thomson hi su|gested 

one bu myo f’y brigading the categories separately 

has foiiTifl objective tests, and in a small trial calculation 

loadiniTR I'n for the view that the general factor 

bv an^bpr f ' \ should be lower, and be supplemented 

by Mother factor, probably a “halo.” 

which suggested a third form of analysis in 

each catevnrt? ^ made responsible for the whole amount of 

It is in fact made to 
above the obierH category correlations over and 

the catevorjpR « correlations. According to his analysis 

nereas the objective tests show only the general factor. More- 
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over the general factor admits of further analysis into tiro well- 
ImoMTi and coiTespondingly illuminative constituents, namely, 
into the bare general factor (or g) together vdth a verbal factor. 
In the opinion of Professor Spearman this analysis is as good 
statisticaUj’^ as the one given in Chapter III and more satisfactory 
from the psychological point of \dew. 



NOTE ON CERTAIN POINTS IN THE MARKING OF 

EXAAHNERS 


Dr. Ebblewhite Smith, in his Statistical Report (para. 46 (ii) )> 
has drawn attention to the reluctance of examiners to award marks 
at the bottom and at the top of the marldng scale, and the con- 
traction of the scale for practical purposes tliereby produced. 

The rarity of marks at the bottom of the scale has, we thiiA, 
a simple explanation. The candidature for an examination in- 
volves the payment of a fee ; and hence it is rare to find candidates 
who Imow absolutely nothing of the subject in which they present 
thernselves. The Itnowledge of a candidate may be exiguous, 
but it is not inappreciable, and examiners recognise this fact. ^ 
The reluctance of teachers and examiners in English composition 
to award the highest mark in their scale, or even one approachmg 
it, is probably due to reasons of a different order. They cling 
to the old idea that the compositions of their pupils should be 
compared with some perfect “ model,” oblivious of the con- 
ditions under which that model iras produced.^ If 
pupils to imitate not the model but the method of great writers, 
Inok forward to different results, both in the class-room 
and the examination-room. We return to our old argument. 
Let us select for our pupils a subject within their grasp, nn 
audience which they can imagine and realise (somewhat smaller 
than the whole civihsed world), an object in writing that they 
can attain, and the top of our marking scale m'll no longer be 
an inaccessible height. Let it not be thought that the standard 
™p ed IS a low one. The task of writing is never easy ; und 
e most experienced of writers can never be assured beforehand 

undertaking, though the more competent win 
often attam it. &> & 


We come to questions of another order affecting not only the 
extremes but the whole of the scale. 

smphcity of numerical marldng is, as we have 
^ e ore, delusive. It conceals among other things the fact 

for obUvipus of the obvious fact that the easiest things 

a XL are its deficiencies. “ If,” 

^^terl^eU ^ adveraary. “ If Monsieur X. is not a great 

Latin, and, 
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that when wc are adding niarlcs we are combining something more 
than numbers and that the sum of our marks may represent 
something different from our resultant impression. 

Here again we are driven back to the question of pmrpose. In 
previous publications we have drawn attention to the important 
distinction between examinations intended to test the attainment 
of a utilisable slcill and examinations intended only to test 
progress towards that attainment. It is clear that a person who 
only gets live addition sums right out of ten, and so has earned 
a total of fifty per cent, of the marlcs, is no more suited to be 
entrusted n*ith calculations of the slightest importance than one 
who gets three or four sums right out of ten. We need not 
trouble about him if we are looldng for a useful calculator. On 
the other hand, marics of this land may be of great value in testing 
his progress and in comparing his progress unth that of others. 
We have pointed out the difficulties wliich arise in School 
Cortificatc examinations when the distinction between these two 
purposes is overlooked.^ The e.xamination in English ought to 
leave no doubt as to what its verdict means. It should declare 
either that the candidate (1) has a utilisable skill in the written 
use of his mother-tongue, or (2) has not such a skill, or (3) is 
considered to be on the borderline. 

We have quoted a kind of scale of marlung in which fifty per 
cent, of the marks must be regarded ns an undoubted failure. 
We now turn to another type in which it has been chosen as the 
“ fixed point ” for the test of a utilisable sldll of the greatest 
importance to the community, in the degree examinations in 
medicine and surgery of the Universities of Ec^burgh and 
London. Descriptions of these particular examinations are given 
in The Purposes of Examinations, A Sijmposinm," by Professor 
T. J. Maclde and Professor F. R. Fraser respectively. Professor 
Mackie of Edinburgh writes ; — 

“ A\TiU 6 the marking is on the percentage basis, this must be broadly 
intorproted. The examiner lias liis standard of what coMtitutes a 
passable knowledge ; to tlie minimum of this he assesses 50 per cent, 
and the deviations above or below tliis level are marked aocordmgly. 
(Op. cU. p. G8.) 


Professor Fraser, of London, is even more explicit : 

“ The method usually adopted by the examiners is to give 50 per omt. 
of tho total for eacli question if the candidate’s performance suffic^t 
and only just sufSeient to reach the standard traditional for the degree 

^Secondary School Eza,m,u.tions, etc. by Sir P. ^artog. publkhed by the 
National Umon of Teachers, Hamilton mf ' 

’ Reprinted from tho Year Book of Education.(B%yns Brothers, 3/-). The 
book contains a description of 22 important exnmmations. 
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and to give more or less marlts ns tho pcrfonnnnco varies from thi-. 
In judging tho answors or performance! of a candidate, tho attamnien 
of knowIocJgo BUfheiont to qunlifj' for practice, with something 
more to justify tho conferment of tho 5I.I3,, B.S. degrees of the Uiwerei y, 
affords a satisfactorj’ ‘ fixed point ’ around wliich tho merits of ^ 
candidates can bo assessed. With this method of marking, and 
high standard demanded for a pass, it is difficult to conceive of an. 
candidate deserving t\rico ns many marks ns those required for a P®®'’ 
and the figures aro generally, therefore, on tho low side ; so 
75 per cent, is rarcl 3 ' given except in tho practicals,” {Op- ci(. p- ‘“•I 

Dr. liVaser goes on to explain tliat on this system tfie actual mark 
first allotted to any candidate considered for the distinction o 
Honours is usually below that prescribed in the regulations, 
because of the adoption of a system of marking which was 
designed for a qualifying examination rather than a competitive 
one ; so that it has become customary to adjust the marks of _ ^ 
candidates selected for Honours so that the regulations of ® 
University may be complied with (op. cit. p. 73). ^ 

It is interesting to see how a purely numerical S 5 ' 6 tem of mariMg 
has been modified to suit the actual needs of’examinations of ® 
first importance designed to test utilisable skill. It may ® 
added that at the London examination each candidate passes 
through the hands of fourteen different pairs of examiners. 

We shall take as a final example a suggested modification in t ve 
allotment of marks at an examination, originally designed as a 
pass examination, to adapt it at the same time to the nee 
of a competitive examination. In a recent report on the 
School Certificate examination the Government Investigates 
frankly recommended that panels of examiners who thought 
a candidate ought to have a State Scholarship should justify 
that opinion by giving specially high marks to his papers. 
Commenting on the double purpose of the examination as a 
pass and as a competitive examination they say : — 

The double functiou of tho Examination connot be adequately 
POTormed if the marking schemes are laid down too rigidly. A inarKing 
scheme, adequate and fair for the average candidate, may do 
mjustice to the able boy, and a complete catalogue of facts may S 
greater credit than an able and original discussion. For this 
^ ™P.ovtant for panels of examiners to make up their minds 
^ahUes they are looking for in the scholarship candidate and, 
n^ find them, to indicate this clearly either by a system of staffing 
or by the allocation of a high mark, unfettered by too rigid a marking 
scheme or even ignoring such scheme altogether.” ^ 


nf Certificate Examination. Being the Report of the 

ennuim appointed by the Secondary School Examinations Counci 

approved Higher School Certificate Examinations held m 
he Btmuner of 1937 (H.M. Stationery Office, Is. 6d.), pp. 31-32. 
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In the three cases just quoted, the allotment of numerical 
marks is clearly regarded as of use for a preliminary judgment, 
but serious departures from these marks are made, or recom- 
mended to be made, to adapt the examinations to their precise 
purposes. In examinations on a large scale, far more than in 
those on a small scale, is iratchful inspection of the actual results 
attained necessary to avoid a contentment based merely on 
statistical curves. 

In paras. 102 and 103 above Dr. Efablov'hite Smith has warned 
the reader that “while correlation coefficients . and standard 
deviations give valuable information on the statistical relation of 
two series of figures they fail to give some of the most important 
facts needed by examiners and examining bodies which can only 
be obtained by comparing the actual marks awarded.” 

Ho has supplemented this statement by a paper, written before 
his departure from England, and published in the Journal of 
Education for May, 1941 (p. 180). Ho reminds us by a hypo- 
thetical example that two examiners might allot marks to six 
candidates of wliich the rank-correlation coefficient was 1 (i.e. the 
correlation was perfect) and yet that, if 33% was regarded as the 
limit for a pass, 50% for credit and C6% for distinction, they 
might in no instance award the same mark ; that there might he 
an average difference of 30 marks between them ; and that only 
one candidate might be placed in the same class by both examiners. 

He then takes another example of two sets of six marks, again 
with perfect ranlr-correlation, but this time with the same general 
average, and in .which the average difference between the marks 
allotted to the same candidate is 16%, and only two of the 
candidates would be placed in the same class by both examiners. 

Finally, he points out that in an examination in which 20% of 
the candidates failed, and the correlation-coefficient between 
two examiners reaches the exceptionally high value of -^0.95, it 
is to be expected that 7% of the candidates will be "failed” by 
one examiner and passed by another ; and he concludes that in 
most examinations the element of chance affects far more than 
7 % of the candidates. 



NOTE ON AN INVESTIGATION ON THE IVIAEIONG OF 
ENGLISH COMPOSITION BY DR. B. M. D. CAST 

T? should l)e made to an interesting thesis by Pf. 

r- j. Efficiency of Different Methods of 3farJ:ing 

Composition, of which an abridgement was published in 

the Bntish Journal of Educational Psychology, Vol. IX (1939), 

pp. 257-269, and Vol. X (1940), pp. 49-60. The original is 

deposited m the library of the University of London. Forty 

essays of the pupils of a central school for girls, aged 14| to 15j, 

I! independently according to four different methods 

oy twelve different examiners. The subject chosen had been 

sugge d by Sir Phihp Hartog. It was not, however, a “ directed ” 

u jec , but at the second marking for “ achievement of aim, 

louring the principle suggested by Sir Philip Hartog, the 

fho asi-e(j consider “ how far has the writer achieved 

implicitly put before himself.” Pr- 

P- 268) “ although Hartog’s criterion 

principle for teaching, it is too precarious 

f pnnciple for marldng.” Ut is to be noted that 

and “ ^ ^ ,, more precarious when the “ object " 

an nn^or~^- writer have to be guessed by the examinor, 

rrri y which is avoided when the subject is directed.] 

of n-as intended primarily as a preliminary study 

PohoTrino- ^PP^npriatc to the investigation of such problems. 

I^Iiss Catif an on the subject by Professor Burt, 

analvsis of ^ data, first of aU by the method known as 

ciudiysig oi variance n.nrl 



one anoflie,. a j j show that the two methods supplemented 
the concw!“f th® same conclusion. As regards 

statement that P®^^aps the most relevant here is her 

yielded bv thn concordant set of marks were those 

on a svst^ ^ the marks were given 

not folly described (Menial and Scholastic Tests, p. 331) 

achievement marhnri thesis, and the least concordant by the 
is difiScult to iudffP would suggest that it 

this kind withonf^p ° results attained in an investigation of 
award a hieh a 1o of the compositions to which examiners 

1». been iSpotajI' f ■?“*■ Owing to the war it 

^possible to consult the fuU text of the thesis. 
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APPENDIX 
OBJECTHTE TESTS. 
TEST 2. OPPOSITES. 


Name of Candidate (surname in block letlers) 

Age......... Years ^lontlis Bate of Birtli. 

School 

Class 

Date of Test 


Dibectioxs for Candidates 

In each question, find among the fo.« nnmbered worfs letter^ 

the one that is most nearl.v opposite m nwninng o P , 

letters. Put the number of the chosen -n-ord m the bracket at the end of 

the line. , _ , 

1 new 2 insipid 3 stale 4 loathsome - ( 3 ) 


Example : FRESH 

1. SAD - 

2. NATRTE - 

3. HOPE - 

4. CERTAIN - 
6. COLOSSAL 

6. ENGAGE - 

7. BRILLIANCE 

5. RELAX 

9. CLAMOUR - 

10. KNOM^LEDGE 

11. BOLD - 

12. niPROYE - 

13. ABUNDANT 

14. ADMIT 

15. ARTIFICIAL 

16. COURTESY 


17. GRANT 

18. IDLE - 

19. FLOURISH 

20. JEOPARDY 

21. CORPULENT 


1 serious 2 charming 3 cheerful 4 bad 
1 coloured 2 relative 3 rustic 4 foreign - 
1 faith 2 distrust 3 distress 4 despair - 
1 doubtful 2 possible 3 careless 4 probable 
1 disappointing 2 poor 3 smaU 4 dull 
1 depart 2 leave 3 dismiss 4 degrade - . 

1 blackness 2 dullness 3bluntne^ 4 squalor ( 
1 1- o 4 bend • “ 1 


- ( ) 


) 

( ) 
( ) 
i ) 
( ) 
) 


llaugh 2 weep 3 tighten 4 bend 
1 deceit 2 singing 3 meekness 4 * 

1 clumsiness 2 ignorance 3 a-ulgarity 
4 stupidity - 
1 weak 2 desirous 3 tnmd 4 
1 iranair 2 bum 3 mvalidate 4 aiinui 
1 small 2 scarce 3 reduced 4 miserly - 
Invent 2 reproach 3 exhaust 4 exclude 
lordinarv "superficial 3 plain 4 natural 
1 2 thoughtlessness 3 rudeness 

4 cruditv - ~ ~ , 

1 refuse 2 eject 3 exclude 4 grudge - 
1 obedient 2 ambitious 3 prudent 
4 industrious 

1 floimder 2 deeav 3 mature 4 age - 

} ceSty 2s«fety Sescape ^pmc^ution 

1. CORPULENT - of Industrial 

I Test 1 was a Group-fctclligmro 04 aboi-e.) 

'sychologj', and is, therefore, not reprmted lie I 
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22. INDISPUTABLE - 

23. KINDLE - 

24. FRAILTY - 

25. SURPLUS - 

26. SERENE - 

27. MONOTONY 

28. INJURY - 

29. PROFOUND 

30. ANCESTOR 

31. LENIENT - 

32. NOBLE 

33. SUCCEED - 

34. ETERNAL - 
36. CONDEaiN 


1 doubtful 2 possible 3 valuable 4 certain ( ) 
1 discourage 2 extinguish 3 freeze 4 starve ( | 
frigidity 2 beauty 3 strength 4 brittleness ( 

1 arrears 2 minus 3 deficit 4 remamder - \ 

1 perturbed 2 displaced 3 disjointea 

4 unpleasant - - i i- v,+ f 1 

1 variety 2 noise 3 excitement 4 dehgM i 
1 compensation 2 benefit 3 reward 
4 health - - * ' c • i ' 

1 unlettered 2 confused 3 superficia ^ 
4 unversed - - - ", ^ 

1 forefather 2 descendant 3 relative ^ 
4 progenitor - - - ~ \ 

1 unkind 2 unsympathetic 3 energetic ^ 

1 little 2 base 3 uncivilised 4 poor - ' | . 

1 lose 2 recede 3 fail 4 blunder - ' J , 

1 infernal 2 seasonal 3 abrupt 4 temporary J 
1 appraise 2 approve 3 retain 4 value - v 


TEST 3. SPELLING^ 

Name of Candidate {surname in block letters) 

■^8® Years Months Date of Birth. 

School 


Class 


Date of Test 

N.B. Do not write anything in the column left blank at the right h 
of the page. 

Itigbt 


1. The room was so low that ho could touch the [ceiling) with his hand 

2. The roynl_ - 

3. There is a considerable body of_ [emdence) against you * 

4. With difBculty he ,...[«nccce^]_Yn reachi^' the door - • ' 

o. The oranges are_ [delic ioits) 

tsficretor^] — answered most of the letters - - ' 

who disliked aU [foreigners) 

o ® — .tir5.‘^Lfe’:L._i^'ma^TJ^ntrie3 - 

scarcely control her [disappointment] . - - 

10. The doctor gave the patient morphTiTo [Pelade) the pain - 

1 2' Tl — “5~^if2^^^__well made to stand the strain - 

12^. Tliey showed their._ J_a^rora0.__ by clapping - - - 

above. motbod of administration of the test is given 

lines wore left WarS- ®"Pplied to tho pupil the spaces indicated by thy d 

within bracl-cts ^ ‘ho missing words printed hero m 

sentSeeb '"ho administered the test roa^ aloud ekwJy each 
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Bight 


Brought forward 

T clmll [anxiousry] await your return 

Yot - ■ : 

I hope you -will^ [acce pt] this small gift - 

; s: 5 

j [cspcciai/p]_ asked John to come 

! [receipt] for all mone}' spent - - 

. She was ' [rccomnninded] for a scholarship 

. Nothing can reverse my — _ [d^£i 5 i£!i] Wodnesdav - 

T .uoii no [opportmutp] ^to see you before B ednesQ y 

• ™ ■■■VrJTr^rr? iin rconumtlee] to-morrow 

1. There will bo a meetmg ot tne ^ 

nn [acgiiaintancc] of many years rfandmg - 
She IS an — ; ^ in America 

I. It is many years since sla%'ery of rubbish 

i- fj’rsr ™ 

3 . He fell to the ^ 

1 . Such a plan is not ^ cave • - ' " 

S. His voice was ____fi££r£ 5 l - - - 

R rinrmmerabte] rats poured mto the castle _ 

j! - - 

18 . It'is difficult to work amid.^ ^^l^d good books 

!9. All men should har^ |„^^ . . . - 

10. Pew men can tolerate i 

Total munber - * ‘ 


. rOTOTUATIOK AND I™ 


TEST 4, 


Name of Candidate {surname in 


hloch letters). 


Ago Years 

School 

Class 

Date of Test 


.'...Months 


Date of Birth.. 
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DtBECTIONS FOB CaFTDIDATES. 


In each line below, one serious error has been made in punctuation. 
WTiere a punctuation mark has been omitted, supply it. Where you 
find a wrong punctuation mark, or a wrong capital letter, or a small letter 
mstead of a capital, put a ring roimd it, but do not correct it. It is ini' 
portant to note that only one serious error has been made in each lin^ 
Read each passage through as a whole before attempting to make your 
corrections in the separate lines, as in some cases it is impossible to make 
the right correction in a line without taking into account the lines which 
precede or which follow it. 


Exam-pie : Talking of axes , ” Said the Duchess, 
chop off her head ! 

^ou will be told by the Supervisor how to mark this example. 
N-B.— Do not write anything in the column left blank at the right hand 

of the page. 

' Bight 


horse stopped which 
It did very often ) , he , fell ofi 
m front ; And , whenever it went 

generaUy, did 
rather suddenly , he fell off 
behind 


“ Take care ” cried Alice ; but it 

th« slipped , 

What a pricked her finger 

«bat a thick black cloud that 

Oft* , it 

comes 1 my, I jjo beiigve its 
got wings ! 


ni? going to turn into a 

“ f’l’i niioo seriously 

MW •"™ •» Oo V. 






ArrKs'wx T 


ici 

Higlit 


BrotiKlit fonvnrt! 


‘m old cmb fftki lo ((•'r non . 

liy «Jo you wnlk nidowajoi liJ:o tlint . 
iny non You oiipht to wnlk fitraifllit , ’* 
younR cml> rt'pliVl “ Shoxv run Itow . 
«p!\r trrol}lt'^ nnd ril follou- voiir oinriipfn . " 
‘b" old cmh tn’nrJ . »,ui m-xi in vnin , 

Ji?ui ilKsn ; iawf how >tbrt Jmt! 

to find , fnuit «-ii)i Iwr child. 


A qunon lH>n from liymottuo flow 
»';> to Olympiw with notrin frosh Honey 
from the hivo rw rr prt'oent to Jupiter 
'vjio wfin no frlea'jfyl , with the gill. tJiiil )io 
prornirtetl to give Iier nnjthing, iiho lifttxi 
to nil; for . rdio nmd niie wnnicrl 
him to gift! stinp't to the heed 


drtnn(le<! the omtor was onco npcnking 
in the An'iernlily nt ntlien.n ; hut tho people 
were very . iimttr'ntive to what ho «-na Frying ; 
Bo ho filoppod and Raid . " gontioincn , 

I Bhotild like to tell you ono of Aosopa 
fables ” This rnndo ovoryono listen intently . 
then Deinndcs began : “ Deinoler , n Bwnllorr 
and An col wore onco travelling together , 
and cnino to a Kivor without n bridge ; 
tho swallow flow , over it , and tho col 
Birom across ” ; and then Ito Btopped , 

*■ What hnirpoiicd to Domoler ’’ cried sovoral 
people in tho nudionco . “ Doinoter , ho replied , 
** is very ntigry* with yon • for Jhtciung to 
Fables when you ought to bo minding 
public business , 


A trumpotor ; being enptun^ tho onomy , 
bogged for hia life , ond said , do uot pul- 
mo to death; I liavo Idllod no-ono . Indood , 
2 Jiovo no weapon : but carry with mo 
only roy trumpet horo . 
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THE MAEKING. OF ENGLISH ESSAYS 


test 6. WORD JDEANING 

[The details of names of candidates, etc., were printed in this place as in previous tests.] 

DniECTIONS FOB CANDIDATES 


corresDonds^ in set out below there is a -word or phrase which approximately 

Underline in each ad * u ’'^'o^d in capital letters lyhich precedes the sentence, 
ouuenme m each case such word or phraseT 

samp e : '^^^^'■Those who came to worship stayed to decorate the shrine with 
t write anything in the column left blank at the right hand of the ] 


1. ANGUISH - 

2. DISCUSSION 

3. AWARE 

4. ADAGE 

6. CELESTIAL 
6. DEEEAXIDED 


7. COGENT . 

8. CONJECTURE 

0. fortitude 
10. querulous 

11- SQUALID . 

12. disparage 
13- enigma . 


His spiteful rage was appeased at the sight of 
their distress 

He excelled in sermon and oration but took no 
part in quarrel or argument - - - - 

Careful ! My friend, our clever enemy is 
awake and conscious of our presence ” 

Age accumulates many a wise saying for the 
guidance of youth 

GIorioiM Spring with sweet voice awakens earth- 
born birds with heavenly song - • ■ 

He robbed the rich, cheated the poor of their 
savings, and his untrustworthy evidence 
m the dock brought him a further conviction for 
perjury 

In suitable terms ho laid before them logical 
arguments sufficiently forcible to convince the 
most sceptical 

And mth this sweep of his arm ho brushed aside 
eir doubt ; no longer was there need to guess, 
ey were now in possession of the complete 
argument - . . , . . . 

di^laycd his great strength and courage 
of life agoinst groat odds in the battle 

woman was quick and active in 
ays, often angry and always complaining - 

Kio screaming urchins in tho unpleasant streets 
wore a dirty sight - . . . 

cottage or belittle the slcy- 
mnt- ’ both have virtues that the wise man 
may appreciate 

Mriour rliymr^”®^^^ “ “ 
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Bight 



Brought fonrard 


14 . 

EXPOUKDED - 

BTiilo he argued ho gesticulated, and os ho 
explained he struck the desk . - - - 


15 . 

UBIQUITOUS - 

Tho wicked ore to be found overj-whoro ond even 
government has its quota .... 


16 . 

FACILITY - 

Ho was singularly successful in all forms of sport 
and ho rodo and swam with equal ease - 


17 . 

FEIGN 

To pretend to tho throne does not mean to 
imitate royalty, nor to protend to have royal 
blood 


18 . 

FLEXIBLE 

IVith nimble fingers and incredible skiU ho 
fashioned weird figures from the pliable hempen 
strands 


19 . 

INANIMATE 

Tlio still silent figure wliich ot firet ho took to bo 
lifeless proved to be the body of a sleepmg man 


20. 

LAPSE 

It took him but a few moments to recognise his 
slip and ho fell to his knees and begged his 
miitor’s forgiveness 


21. 

LOQUACIOUS - 

Ho was fond of drinking and in his cups he would 
tocome first talkative, then quarrelsome, and 
finally sleepy 


”2 

MALICE - 

Ho was a creature to bo despised : he cherished 
hatred for tho police and his treatment of his 
friends was characterised by spite ond ill-temper 

1 

23 . 

PATHETIC - 

The lonclv child was miserable and her pitiful 
weeping roused the sympathy of the passers-by 


24 . 

OPTION - 

You have no choice ; my decision is final and 
you roust accept my conditions - . , 


25 . 

tbanquillity- 

The age of the place and its deserted look gave 
it an air of expectancy and quietness, so soon 
to bo destroyed by the soldiery 


26 . 

TEMERITY 

Impudonce is often fear and rashness merely 

foolishness - . 
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APPENDIX n 


SAMPLE OP markhstg-sheet fob essays. 
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APPENDIX H — continued 


Designation 

of 

Candidate. 

«? 

c 

o 

cc 

(a) 

c 

<3 

s 

cc 

,S 

*0 

CO 

(C) 

i » 

{nil 

ha tc; 

J c ~ C 

(rf) 

tcj 

'z i <- 
3 1 o 

■ ^ 

fl 1 

1 (^) 

-g 

o 

o 

> 

1 

o o 

Cl »4 

C 3 

gg 

“5 

(9) 

c? 

*3.2 

Ct (D 
O M 

SI 

of 

M 

(A) 

1 ^ 

2 

1 2 

(0 

40 










41 










' 42 


1 







I 

43 

1 



1 

1 

i 




44 




1 






45 



1 







40 


1 








47 










48 










. 49 










60 







1 







' 



1 




Date 


Signature of Exominer 










